Oct 26 09:19:40 user nova-compute[74075]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74075) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 09:19:40 user nova-compute[74075]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74075) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 09:19:40 user nova-compute[74075]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74075) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 09:19:40 user nova-compute[74075]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.017s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:19:41 user nova-compute[74075]: INFO nova.virt.driver [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 26 09:19:41 user nova-compute[74075]: INFO nova.compute.provider_config [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Acquiring lock "singleton_lock" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Acquired lock "singleton_lock" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Releasing lock "singleton_lock" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Full set of CONF: {{(pid=74075) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ******************************************************************************** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Configuration options gathered from: {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ================================================================================ {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] allow_resize_to_same_host      = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] arq_binding_timeout            = 300 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] backdoor_port                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] backdoor_socket                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] block_device_allocate_retries  = 300 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] block_device_allocate_retries_interval = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cert                           = self.pem {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute_monitors               = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] config_dir                     = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] config_drive_format            = iso9660 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] config_source                  = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] console_host                   = user {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] control_exchange               = nova {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cpu_allocation_ratio           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] daemon                         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] debug                          = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] default_access_ip_network_name = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] default_availability_zone      = nova {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] default_ephemeral_format       = ext4 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] default_green_pool_size        = 1000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] default_schedule_zone          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] disk_allocation_ratio          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] enable_new_services            = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] enabled_ssl_apis               = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] flat_injected                  = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] force_config_drive             = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] force_raw_images               = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] graceful_shutdown_timeout      = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] heal_instance_info_cache_interval = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] host                           = user {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_build_timeout         = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_delete_interval       = 300 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_name_template         = instance-%08x {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_usage_audit           = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_usage_audit_period    = month {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] internal_service_availability_zone = internal {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] key                            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] live_migration_retry_count     = 30 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_config_append              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_dir                        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_file                       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_options                    = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_rotate_interval            = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_rotate_interval_type       = days {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] log_rotation_type              = none {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] long_rpc_timeout               = 1800 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] max_concurrent_builds          = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] max_concurrent_live_migrations = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] max_concurrent_snapshots       = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] max_local_block_devices        = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] max_logfile_count              = 30 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] max_logfile_size_mb            = 200 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] maximum_instance_delete_attempts = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metadata_listen                = 0.0.0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metadata_listen_port           = 8775 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metadata_workers               = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] migrate_max_retries            = -1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] mkisofs_cmd                    = genisoimage {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] my_ip                          = 10.0.0.210 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] network_allocate_retries       = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] osapi_compute_listen_port      = 8774 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] osapi_compute_unique_server_name_scope =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] osapi_compute_workers          = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] password_length                = 12 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] periodic_enable                = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] periodic_fuzzy_delay           = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] pointer_model                  = ps2mouse {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] preallocate_images             = none {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] publish_errors                 = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] pybasedir                      = /opt/stack/nova {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ram_allocation_ratio           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rate_limit_burst               = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rate_limit_except_level        = CRITICAL {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rate_limit_interval            = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reboot_timeout                 = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reclaim_instance_interval      = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] record                         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reimage_timeout_per_gb         = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] report_interval                = 120 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rescue_timeout                 = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reserved_host_cpus             = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reserved_host_disk_mb          = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reserved_host_memory_mb        = 512 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] reserved_huge_pages            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] resize_confirm_window          = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] resize_fs_using_block_device   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] resume_guests_state_on_host_boot = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rpc_response_timeout           = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] run_external_periodic_tasks    = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] running_deleted_instance_action = reap {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] running_deleted_instance_timeout = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler_instance_sync_interval = 120 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_down_time              = 720 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] servicegroup_driver            = db {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] shelved_offload_time           = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] shelved_poll_interval          = 3600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] shutdown_timeout               = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] source_is_ipv6                 = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ssl_only                       = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] state_path                     = /opt/stack/data/nova {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] sync_power_state_interval      = 600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] sync_power_state_pool_size     = 1000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] syslog_log_facility            = LOG_USER {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] tempdir                        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] timeout_nbd                    = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] transport_url                  = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] update_resources_interval      = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_cow_images                 = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_eventlog                   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_journal                    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_json                       = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_rootwrap_daemon            = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_stderr                     = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] use_syslog                     = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vcpu_pin_set                   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plugging_is_fatal          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plugging_timeout           = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] virt_mkfs                      = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] volume_usage_poll_interval     = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] watch_log_file                 = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] web                            = /usr/share/spice-html5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_concurrency.disable_process_locking = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.auth_strategy              = keystone {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.compute_link_prefix        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.dhcp_domain                = novalocal {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.enable_instance_password   = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.glance_link_prefix         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.instance_list_per_project_cells = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.list_records_by_skipping_down_cells = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.local_metadata_per_cell    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.max_limit                  = 1000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.metadata_cache_expiration  = 15 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.neutron_default_tenant_id  = default {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.use_forwarded_for          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.use_neutron_default_nets   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_dynamic_targets = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_jsonfile_path   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.backend_argument         = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.config_prefix            = cache.oslo {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.dead_timeout             = 60.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.debug_cache_backend      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.enable_retry_client      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.enable_socket_keepalive  = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.enabled                  = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.expiration_time          = 600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.hashclient_retry_attempts = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_dead_retry      = 300 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_password        =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_sasl_enabled    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.memcache_username        =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.proxies                  = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.retry_attempts           = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.retry_delay              = 0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.socket_keepalive_count   = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.socket_keepalive_idle    = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.socket_keepalive_interval = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.tls_allowed_ciphers      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.tls_cafile               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.tls_certfile             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.tls_enabled              = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cache.tls_keyfile              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.auth_section            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.auth_type               = password {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.cafile                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.certfile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.collect_timing          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.cross_az_attach         = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.debug                   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.endpoint_template       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.http_retries            = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.insecure                = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.keyfile                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.os_region_name          = RegionOne {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.split_loggers           = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cinder.timeout                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.cpu_dedicated_set      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.cpu_shared_set         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.image_type_exclude_list = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.resource_provider_association_refresh = 300 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.shutdown_retry_interval = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] conductor.workers              = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] console.allowed_origins        = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] console.ssl_ciphers            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] console.ssl_minimum_version    = default {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] consoleauth.token_ttl          = 600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.cafile                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.certfile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.collect_timing          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.connect_retries         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.connect_retry_delay     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.endpoint_override       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.insecure                = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.keyfile                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.max_version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.min_version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.region_name             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.service_name            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.service_type            = accelerator {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.split_loggers           = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.status_code_retries     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.timeout                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] cyborg.version                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.backend               = sqlalchemy {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.connection            = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.connection_debug      = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.connection_parameters =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.connection_recycle_time = 3600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.connection_trace      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.db_inc_retry_interval = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.db_max_retries        = 20 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.db_max_retry_interval = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.db_retry_interval     = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.max_overflow          = 50 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.max_pool_size         = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.max_retries           = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.mysql_wsrep_sync_wait = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.pool_timeout          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.retry_interval        = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.slave_connection      = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] database.sqlite_synchronous    = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.backend           = sqlalchemy {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.connection        = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.connection_debug  = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.connection_parameters =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.connection_recycle_time = 3600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.connection_trace  = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.db_inc_retry_interval = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.db_max_retries    = 20 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.db_max_retry_interval = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.db_retry_interval = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.max_overflow      = 50 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.max_pool_size     = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.max_retries       = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.pool_timeout      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.retry_interval    = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.slave_connection  = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] api_database.sqlite_synchronous = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] devices.enabled_mdev_types     = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ephemeral_storage_encryption.enabled = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.api_servers             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.cafile                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.certfile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.collect_timing          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.connect_retries         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.connect_retry_delay     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.debug                   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.default_trusted_certificate_ids = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.enable_certificate_validation = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.enable_rbd_download     = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.endpoint_override       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.insecure                = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.keyfile                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.max_version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.min_version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.num_retries             = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.rbd_ceph_conf           =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.rbd_connect_timeout     = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.rbd_pool                =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.rbd_user                =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.region_name             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.service_name            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.service_type            = image {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.split_loggers           = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.status_code_retries     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.timeout                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.verify_glance_signatures = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] glance.version                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] guestfs.debug                  = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.config_drive_cdrom      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.config_drive_inject_password = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.enable_remotefx         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.instances_path_share    =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.limit_cpu_features      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.use_multipath_io        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.vswitch_name            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] mks.enabled                    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] image_cache.manager_interval   = 2400 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] image_cache.precache_concurrency = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] image_cache.remove_unused_base_images = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] image_cache.subdirectory_name  = _base {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.api_max_retries         = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.api_retry_interval      = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.auth_section            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.auth_type               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.cafile                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.certfile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.collect_timing          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.conductor_group         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.connect_retries         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.connect_retry_delay     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.endpoint_override       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.insecure                = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.keyfile                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.max_version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.min_version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.peer_list               = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.region_name             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.serial_console_state_timeout = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.service_name            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.service_type            = baremetal {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.split_loggers           = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.status_code_retries     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.timeout                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ironic.version                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] key_manager.fixed_key          = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.barbican_api_version  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.barbican_endpoint     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.barbican_endpoint_type = public {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.barbican_region_name  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.cafile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.certfile              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.collect_timing        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.insecure              = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.keyfile               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.number_of_retries     = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.retry_delay           = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.send_service_user_token = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.split_loggers         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.timeout               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.verify_ssl            = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican.verify_ssl_path       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.auth_section = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.auth_type = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.cafile   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.certfile = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.collect_timing = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.insecure = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.keyfile  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.split_loggers = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] barbican_service_user.timeout  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.approle_role_id          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.approle_secret_id        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.cafile                   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.certfile                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.collect_timing           = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.insecure                 = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.keyfile                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.kv_mountpoint            = secret {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.kv_path                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.kv_version               = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.namespace                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.root_token_id            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.split_loggers            = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.ssl_ca_crt_file          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.timeout                  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.use_ssl                  = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.auth_section          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.auth_type             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.cafile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.certfile              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.collect_timing        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.connect_retries       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.connect_retry_delay   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.endpoint_override     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.insecure              = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.keyfile               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.max_version           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.min_version           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.region_name           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.service_name          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.service_type          = identity {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.split_loggers         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.status_code_retries   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.timeout               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] keystone.version               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.connection_uri         =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_mode               = custom {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: WARNING oslo_config.cfg [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_power_governor_high = performance {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_power_management   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.device_detach_attempts = 8 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.device_detach_timeout  = 20 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.disk_cachemodes        = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.disk_prefix            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.enabled_perf_events    = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.file_backed_memory     = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.gid_maps               = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.hw_disk_discard        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.hw_machine_type        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_rbd_pool        = rbd {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_type            = default {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.images_volume_group    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.inject_key             = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.inject_partition       = -2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.inject_password        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.iscsi_iface            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.iser_use_multipath     = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_downtime = 500 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_inbound_addr = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_scheme  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_timeout_action = abort {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_tunnelled = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: WARNING oslo_config.cfg [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 26 09:19:41 user nova-compute[74075]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 26 09:19:41 user nova-compute[74075]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 26 09:19:41 user nova-compute[74075]: and ``live_migration_inbound_addr`` respectively.
Oct 26 09:19:41 user nova-compute[74075]: ).  Its value may be silently ignored in the future.
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.live_migration_with_native_tls = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.max_queues             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.nfs_mount_options      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.num_pcie_ports         = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.pmem_namespaces        = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.quobyte_client_cfg     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rbd_secret_uuid        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rbd_user               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rescue_image_id        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rescue_kernel_id       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.rx_queue_size          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.smbfs_mount_options    =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.snapshot_compression   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.snapshot_image_format  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.sparse_logical_volumes = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.swtpm_enabled          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.swtpm_group            = tss {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.swtpm_user             = tss {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.sysinfo_serial         = unique {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.tb_cache_size          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.tx_queue_size          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.uid_maps               = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.use_virtio_for_bridges = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.virt_type              = kvm {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.volume_clear           = zero {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.volume_clear_size      = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.volume_use_multipath   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_cache_path   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.auth_section           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.auth_type              = password {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.cafile                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.certfile               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.collect_timing         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.connect_retries        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.connect_retry_delay    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.default_floating_pool  = public {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.endpoint_override      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.extension_sync_interval = 600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.http_retries           = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.insecure               = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.keyfile                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.max_version            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.min_version            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.ovs_bridge             = br-int {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.physnets               = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.region_name            = RegionOne {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.service_metadata_proxy = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.service_name           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.service_type           = network {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.split_loggers          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.status_code_retries    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.timeout                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] neutron.version                = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] notifications.bdms_in_notifications = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] notifications.default_level    = INFO {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] notifications.notification_format = unversioned {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] notifications.notify_on_state_change = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] pci.alias                      = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] pci.device_spec                = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] pci.report_in_placement        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.auth_section         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.auth_type            = password {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.cafile               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.certfile             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.collect_timing       = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.connect_retries      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.connect_retry_delay  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.default_domain_id    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.default_domain_name  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.domain_id            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.domain_name          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.endpoint_override    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.insecure             = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.keyfile              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.max_version          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.min_version          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.password             = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.project_domain_id    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.project_domain_name  = Default {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.project_id           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.project_name         = service {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.region_name          = RegionOne {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.service_name         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.service_type         = placement {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.split_loggers        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.status_code_retries  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.system_scope         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.timeout              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.trust_id             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.user_domain_id       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.user_domain_name     = Default {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.user_id              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.username             = placement {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] placement.version              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.cores                    = 20 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.count_usage_from_placement = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.injected_file_content_bytes = 10240 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.injected_file_path_length = 255 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.injected_files           = 5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.instances                = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.key_pairs                = 100 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.metadata_items           = 128 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.ram                      = 51200 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.recheck_quota            = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.server_group_members     = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] quota.server_groups            = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rdp.enabled                    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.image_metadata_prefilter = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.max_attempts         = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.max_placement_results = 1000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] scheduler.workers              = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.host_subset_size = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.isolated_hosts = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.isolated_images = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.pci_in_placement = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.track_instance_changes = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metrics.required               = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metrics.weight_multiplier      = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] metrics.weight_setting         = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] serial_console.enabled         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] serial_console.port_range      = 10000:20000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] serial_console.serialproxy_port = 6083 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.auth_section      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.auth_type         = password {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.cafile            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.certfile          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.collect_timing    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.insecure          = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.keyfile           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.send_service_user_token = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.split_loggers     = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] service_user.timeout           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.agent_enabled            = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.enabled                  = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.html5proxy_port          = 6082 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.image_compression        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.jpeg_compression         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.playback_compression     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.server_listen            = 127.0.0.1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.streaming_mode           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] spice.zlib_compression         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] upgrade_levels.baseapi         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] upgrade_levels.cert            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] upgrade_levels.compute         = auto {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] upgrade_levels.conductor       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] upgrade_levels.scheduler       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.cafile = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.certfile = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.insecure = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vendordata_dynamic_auth.timeout = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.api_retry_count         = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.ca_file                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.cache_prefix            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.cluster_name            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.connection_pool_size    = 10 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.console_delay_seconds   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.datastore_regex         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.host_ip                 = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.host_password           = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.host_port               = 443 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.host_username           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.insecure                = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.integration_bridge      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.maximum_objects         = 100 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.pbm_default_policy      = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.pbm_enabled             = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.pbm_wsdl_location       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.serial_port_proxy_uri   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.serial_port_service_uri = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.task_poll_interval      = 0.5 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.use_linked_clone        = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.vnc_keymap              = en-us {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.vnc_port                = 5900 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vmware.vnc_port_total          = 10000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.auth_schemes               = ['none'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.enabled                    = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.novncproxy_port            = 6080 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.vencrypt_ca_certs          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.vencrypt_client_cert       = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vnc.vencrypt_client_key        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.disable_rootwrap   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.enable_numa_live_migration = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.libvirt_disable_apic = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.client_socket_timeout     = 900 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.default_pool_size         = 1000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.keep_alive                = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.max_header_line           = 16384 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.ssl_ca_file               = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.ssl_cert_file             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.ssl_key_file              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.tcp_keepidle              = 600 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] zvm.ca_file                    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] zvm.cloud_connector_url        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] zvm.reachable_timeout          = 300 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.enforce_new_defaults = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.enforce_scope      = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.policy_default_rule = default {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.connection_string     = messaging:// {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.enabled               = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.es_doc_type           = notification {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.es_scroll_size        = 10000 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.es_scroll_time        = 2m {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.filter_error_trace    = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.hmac_keys             = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.sentinel_service_name = mymaster {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.socket_timeout        = 0.1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.trace_requests        = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler.trace_sqlalchemy      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler_jaeger.process_tags   = {} {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler_jaeger.service_name_prefix = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] profiler_otlp.service_name_prefix = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] remote_debug.host              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] remote_debug.port              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_notifications.retry = -1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.auth_section        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.auth_type           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.cafile              = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.certfile            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.collect_timing      = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.connect_retries     = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.connect_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.endpoint_id         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.endpoint_override   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.insecure            = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.keyfile             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.max_version         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.min_version         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.region_name         = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.service_name        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.service_type        = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.split_loggers       = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.status_code_retries = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.status_code_retry_delay = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.timeout             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.valid_interfaces    = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_limit.version             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_reports.file_event_handler = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] oslo_reports.log_dir           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_ovs_privileged.group  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] vif_plug_ovs_privileged.user   = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.isolate_vif         = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] os_brick.lock_path             = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] privsep_osbrick.capabilities   = [21] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] privsep_osbrick.group          = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] privsep_osbrick.helper_command = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] privsep_osbrick.user           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] nova_sys_admin.group           = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] nova_sys_admin.helper_command  = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] nova_sys_admin.user            = None {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG oslo_service.service [None req-da2462b1-cb4e-4ba6-bf71-cca52b530815 None None] ******************************************************************************** {{(pid=74075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 26 09:19:41 user nova-compute[74075]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Connecting to libvirt: qemu:///system {{(pid=74075) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4664466530> {{(pid=74075) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 26 09:19:41 user nova-compute[74075]: libvirt:  error : internal error: could not initialize domain event timer
Oct 26 09:19:41 user nova-compute[74075]: WARNING nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4664466530> {{(pid=74075) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Starting native event thread {{(pid=74075) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Starting green dispatch thread {{(pid=74075) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Starting connection event dispatch thread {{(pid=74075) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 26 09:19:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Connection event '1' reason 'None'
Oct 26 09:19:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 09:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.mount [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Initialising _HostMountState generation 0 {{(pid=74075) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 26 09:19:49 user nova-compute[74075]: INFO nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host capabilities <capabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <host>
Oct 26 09:19:49 user nova-compute[74075]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 26 09:19:49 user nova-compute[74075]:     <cpu>
Oct 26 09:19:49 user nova-compute[74075]:       <arch>x86_64</arch>
Oct 26 09:19:49 user nova-compute[74075]:       <model>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <microcode version='1070'/>
Oct 26 09:19:49 user nova-compute[74075]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='osxsave'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='invtsc'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='rsba'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature name='skip-l1dfl-vmentry'/>
Oct 26 09:19:49 user nova-compute[74075]:       <pages unit='KiB' size='4'/>
Oct 26 09:19:49 user nova-compute[74075]:       <pages unit='KiB' size='2048'/>
Oct 26 09:19:49 user nova-compute[74075]:     </cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <power_management>
Oct 26 09:19:49 user nova-compute[74075]:       <suspend_mem/>
Oct 26 09:19:49 user nova-compute[74075]:       <suspend_disk/>
Oct 26 09:19:49 user nova-compute[74075]:       <suspend_hybrid/>
Oct 26 09:19:49 user nova-compute[74075]:     </power_management>
Oct 26 09:19:49 user nova-compute[74075]:     <iommu support='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <migration_features>
Oct 26 09:19:49 user nova-compute[74075]:       <live/>
Oct 26 09:19:49 user nova-compute[74075]:       <uri_transports>
Oct 26 09:19:49 user nova-compute[74075]:         <uri_transport>tcp</uri_transport>
Oct 26 09:19:49 user nova-compute[74075]:         <uri_transport>rdma</uri_transport>
Oct 26 09:19:49 user nova-compute[74075]:       </uri_transports>
Oct 26 09:19:49 user nova-compute[74075]:     </migration_features>
Oct 26 09:19:49 user nova-compute[74075]:     <topology>
Oct 26 09:19:49 user nova-compute[74075]:       <cells num='2'>
Oct 26 09:19:49 user nova-compute[74075]:         <cell id='0'>
Oct 26 09:19:49 user nova-compute[74075]:           <memory unit='KiB'>8140616</memory>
Oct 26 09:19:49 user nova-compute[74075]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 26 09:19:49 user nova-compute[74075]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 09:19:49 user nova-compute[74075]:           <distances>
Oct 26 09:19:49 user nova-compute[74075]:             <sibling id='0' value='10'/>
Oct 26 09:19:49 user nova-compute[74075]:             <sibling id='1' value='20'/>
Oct 26 09:19:49 user nova-compute[74075]:           </distances>
Oct 26 09:19:49 user nova-compute[74075]:           <cpus num='6'>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 26 09:19:49 user nova-compute[74075]:           </cpus>
Oct 26 09:19:49 user nova-compute[74075]:         </cell>
Oct 26 09:19:49 user nova-compute[74075]:         <cell id='1'>
Oct 26 09:19:49 user nova-compute[74075]:           <memory unit='KiB'>8255068</memory>
Oct 26 09:19:49 user nova-compute[74075]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 26 09:19:49 user nova-compute[74075]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 09:19:49 user nova-compute[74075]:           <distances>
Oct 26 09:19:49 user nova-compute[74075]:             <sibling id='0' value='20'/>
Oct 26 09:19:49 user nova-compute[74075]:             <sibling id='1' value='10'/>
Oct 26 09:19:49 user nova-compute[74075]:           </distances>
Oct 26 09:19:49 user nova-compute[74075]:           <cpus num='6'>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 26 09:19:49 user nova-compute[74075]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 26 09:19:49 user nova-compute[74075]:           </cpus>
Oct 26 09:19:49 user nova-compute[74075]:         </cell>
Oct 26 09:19:49 user nova-compute[74075]:       </cells>
Oct 26 09:19:49 user nova-compute[74075]:     </topology>
Oct 26 09:19:49 user nova-compute[74075]:     <cache>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 26 09:19:49 user nova-compute[74075]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 26 09:19:49 user nova-compute[74075]:     </cache>
Oct 26 09:19:49 user nova-compute[74075]:     <secmodel>
Oct 26 09:19:49 user nova-compute[74075]:       <model>apparmor</model>
Oct 26 09:19:49 user nova-compute[74075]:       <doi>0</doi>
Oct 26 09:19:49 user nova-compute[74075]:     </secmodel>
Oct 26 09:19:49 user nova-compute[74075]:     <secmodel>
Oct 26 09:19:49 user nova-compute[74075]:       <model>dac</model>
Oct 26 09:19:49 user nova-compute[74075]:       <doi>0</doi>
Oct 26 09:19:49 user nova-compute[74075]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 26 09:19:49 user nova-compute[74075]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 26 09:19:49 user nova-compute[74075]:     </secmodel>
Oct 26 09:19:49 user nova-compute[74075]:   </host>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='alpha'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>clipper</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='armv6l'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>spitz</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>nuri</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>kzm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sx1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>z2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>tosa</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>n810</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>n800</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>terrier</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>midway</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>microbit</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>verdex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>highbank</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>akita</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>connex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>collie</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='armv7l'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>spitz</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>nuri</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>kzm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sx1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>z2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>tosa</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>n810</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>n800</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>terrier</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>midway</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>microbit</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>verdex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>highbank</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>akita</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>connex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>collie</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='aarch64'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>spitz</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>nuri</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>kzm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sx1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>z2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>tosa</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>n810</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>n800</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>terrier</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>midway</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>microbit</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>verdex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>raspi3b</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>highbank</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>akita</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>connex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>collie</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <acpi default='on' toggle='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='cris'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='i686'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>isapc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>microvm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='kvm'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <pae/>
Oct 26 09:19:49 user nova-compute[74075]:       <nonpae/>
Oct 26 09:19:49 user nova-compute[74075]:       <acpi default='on' toggle='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:       <apic default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='m68k'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>an5206</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>q800</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>next-cube</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='microblaze'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='microblazeel'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='mips'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='16'>malta</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='mipsel'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='16'>malta</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='mips64'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='16'>malta</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>pica61</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>magnum</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='mips64el'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='16'>malta</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>pica61</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>magnum</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='16'>boston</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='ppc'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mac99</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>40p</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>taihu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='ppc64'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>taihu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>40p</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mac99</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='ppc64le'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>taihu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>40p</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>mac99</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='riscv32'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='8'>spike</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>opentitan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='8'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='riscv64'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='8'>spike</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>shakti_c</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='8'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='s390x'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='sh4'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>shix</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>r2d</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='sh4eb'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>shix</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>r2d</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='sparc'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>SS-5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>SS-20</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>LX</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>SS-4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>SS-10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>Voyager</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='sparc64'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sun4u</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>niagara</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>sun4v</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='x86_64'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>64</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='1'>isapc</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>microvm</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='kvm'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <acpi default='on' toggle='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:       <apic default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='xtensa'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>sim</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>kc705</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ml605</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx200</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx60</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]:   <guest>
Oct 26 09:19:49 user nova-compute[74075]:     <os_type>hvm</os_type>
Oct 26 09:19:49 user nova-compute[74075]:     <arch name='xtensaeb'>
Oct 26 09:19:49 user nova-compute[74075]:       <wordsize>32</wordsize>
Oct 26 09:19:49 user nova-compute[74075]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='4'>sim</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>kc705</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ml605</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>virt</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx200</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>lx60</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 09:19:49 user nova-compute[74075]:       <domain type='qemu'/>
Oct 26 09:19:49 user nova-compute[74075]:     </arch>
Oct 26 09:19:49 user nova-compute[74075]:     <features>
Oct 26 09:19:49 user nova-compute[74075]:       <cpuselection/>
Oct 26 09:19:49 user nova-compute[74075]:       <deviceboot/>
Oct 26 09:19:49 user nova-compute[74075]:       <disksnapshot default='on' toggle='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     </features>
Oct 26 09:19:49 user nova-compute[74075]:   </guest>
Oct 26 09:19:49 user nova-compute[74075]: </capabilities>
Oct 26 09:19:49 user nova-compute[74075]: 
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-i440fx-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>i686</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='255'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'/>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='lm'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ide</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-q35-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>i686</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='288'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'/>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='lm'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-q35-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>i686</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='288'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'/>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='lm'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-i440fx-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>i686</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='255'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'/>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='lm'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ide</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-i440fx-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>x86_64</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='255'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>efi</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='invtsc'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='rsba'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ide</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-q35-6.2</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>x86_64</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='288'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>efi</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='invtsc'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='rsba'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-q35-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>x86_64</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='288'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>efi</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='invtsc'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='rsba'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 26 09:19:49 user nova-compute[74075]: <domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 09:19:49 user nova-compute[74075]:   <domain>kvm</domain>
Oct 26 09:19:49 user nova-compute[74075]:   <machine>pc-i440fx-jammy</machine>
Oct 26 09:19:49 user nova-compute[74075]:   <arch>x86_64</arch>
Oct 26 09:19:49 user nova-compute[74075]:   <vcpu max='255'/>
Oct 26 09:19:49 user nova-compute[74075]:   <iothreads supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:   <os supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='firmware'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>efi</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:     <loader supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>rom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pflash</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='readonly'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>yes</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='secure'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>no</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </loader>
Oct 26 09:19:49 user nova-compute[74075]:   </os>
Oct 26 09:19:49 user nova-compute[74075]:   <cpu>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-passthrough' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='hostPassthroughMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='maximum' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='maximumMigratable'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>on</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>off</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='host-model' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <vendor>Intel</vendor>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ss'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='vmx'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pcid'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='hypervisor'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arat'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='umip'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='md-clear'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='invtsc'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibpb'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='ibrs'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-stibp'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='rsba'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='erms'/>
Oct 26 09:19:49 user nova-compute[74075]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:     <mode name='custom' supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>qemu64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>qemu32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>phenom</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>pentium</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>n270</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm64</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>kvm32</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>coreduo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>core2duo</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>athlon</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Westmere</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Snowridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Skylake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>SandyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Penryn</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G5</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G4</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G3</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Opteron_G2</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Opteron_G1</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>IvyBridge</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Icelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Haswell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Rome</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-Milan</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>EPYC</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Dhyana</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cooperlake</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>Conroe</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='no'>Broadwell</model>
Oct 26 09:19:49 user nova-compute[74075]:       <model usable='yes'>486</model>
Oct 26 09:19:49 user nova-compute[74075]:     </mode>
Oct 26 09:19:49 user nova-compute[74075]:   </cpu>
Oct 26 09:19:49 user nova-compute[74075]:   <memoryBacking supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:     <enum name='sourceType'>
Oct 26 09:19:49 user nova-compute[74075]:       <value>file</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>anonymous</value>
Oct 26 09:19:49 user nova-compute[74075]:       <value>memfd</value>
Oct 26 09:19:49 user nova-compute[74075]:     </enum>
Oct 26 09:19:49 user nova-compute[74075]:   </memoryBacking>
Oct 26 09:19:49 user nova-compute[74075]:   <devices>
Oct 26 09:19:49 user nova-compute[74075]:     <disk supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='diskDevice'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>disk</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cdrom</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>floppy</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>lun</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='bus'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ide</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>fdc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sata</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </disk>
Oct 26 09:19:49 user nova-compute[74075]:     <graphics supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='type'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>sdl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vnc</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>spice</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egl-headless</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </graphics>
Oct 26 09:19:49 user nova-compute[74075]:     <video supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='modelType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>cirrus</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>vmvga</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>qxl</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>none</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>bochs</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>ramfb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </video>
Oct 26 09:19:49 user nova-compute[74075]:     <hostdev supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='mode'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>subsystem</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='startupPolicy'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>default</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>mandatory</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>requisite</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>optional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='subsysType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>usb</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>pci</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>scsi</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='capsType'/>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='pciBackend'/>
Oct 26 09:19:49 user nova-compute[74075]:     </hostdev>
Oct 26 09:19:49 user nova-compute[74075]:     <rng supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtio-non-transitional</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>random</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>egd</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>builtin</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </rng>
Oct 26 09:19:49 user nova-compute[74075]:     <filesystem supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='driverType'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>path</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>handle</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>virtiofs</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </filesystem>
Oct 26 09:19:49 user nova-compute[74075]:     <tpm supported='yes'>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='model'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-tis</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>tpm-crb</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:       <enum name='backendModel'>
Oct 26 09:19:49 user nova-compute[74075]:         <value>passthrough</value>
Oct 26 09:19:49 user nova-compute[74075]:         <value>emulator</value>
Oct 26 09:19:49 user nova-compute[74075]:       </enum>
Oct 26 09:19:49 user nova-compute[74075]:     </tpm>
Oct 26 09:19:49 user nova-compute[74075]:   </devices>
Oct 26 09:19:49 user nova-compute[74075]:   <features>
Oct 26 09:19:49 user nova-compute[74075]:     <gic supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:     <vmcoreinfo supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <genid supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backingStoreInput supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <backup supported='yes'/>
Oct 26 09:19:49 user nova-compute[74075]:     <sev supported='no'/>
Oct 26 09:19:49 user nova-compute[74075]:   </features>
Oct 26 09:19:49 user nova-compute[74075]: </domainCapabilities>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74075) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74075) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Checking secure boot support for host arch (x86_64) {{(pid=74075) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Checking secure boot support for host arch (x86_64) {{(pid=74075) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Checking secure boot support for host arch (x86_64) {{(pid=74075) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 09:19:49 user nova-compute[74075]: INFO nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Secure Boot support detected
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] cpu compare xml: <cpu match="exact">
Oct 26 09:19:49 user nova-compute[74075]:   <model>Nehalem</model>
Oct 26 09:19:49 user nova-compute[74075]: </cpu>
Oct 26 09:19:49 user nova-compute[74075]:  {{(pid=74075) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 26 09:19:49 user nova-compute[74075]: INFO nova.virt.node [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Generated node identity cc391394-3043-4569-8b55-9a33029ee3cb
Oct 26 09:19:49 user nova-compute[74075]: INFO nova.virt.node [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Wrote node identity cc391394-3043-4569-8b55-9a33029ee3cb to /opt/stack/data/nova/compute_id
Oct 26 09:19:49 user nova-compute[74075]: WARNING nova.compute.manager [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Compute nodes ['cc391394-3043-4569-8b55-9a33029ee3cb'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 26 09:19:49 user nova-compute[74075]: INFO nova.compute.manager [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 26 09:19:49 user nova-compute[74075]: WARNING nova.compute.manager [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 09:19:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:19:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:19:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:19:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Hypervisor/Node resource view: name=user free_ram=10931MB free_disk=26.259288787841797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:19:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:19:49 user nova-compute[74075]: WARNING nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] No compute node record for user:cc391394-3043-4569-8b55-9a33029ee3cb: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cc391394-3043-4569-8b55-9a33029ee3cb could not be found.
Oct 26 09:19:49 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Compute node record created for user:user with uuid: cc391394-3043-4569-8b55-9a33029ee3cb
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:19:50 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] [req-23f78f1f-d897-4f7a-a57d-43379ade045d] Created resource provider record via placement API for resource provider with UUID cc391394-3043-4569-8b55-9a33029ee3cb and name user.
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74075) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 26 09:19:50 user nova-compute[74075]: INFO nova.virt.libvirt.host [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] kernel doesn't support AMD SEV
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Libvirt baseline CPU <cpu>
Oct 26 09:19:50 user nova-compute[74075]:   <arch>x86_64</arch>
Oct 26 09:19:50 user nova-compute[74075]:   <model>Nehalem</model>
Oct 26 09:19:50 user nova-compute[74075]:   <vendor>Intel</vendor>
Oct 26 09:19:50 user nova-compute[74075]:   <topology sockets="6" cores="1" threads="1"/>
Oct 26 09:19:50 user nova-compute[74075]: </cpu>
Oct 26 09:19:50 user nova-compute[74075]:  {{(pid=74075) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Updated inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Updating resource provider cc391394-3043-4569-8b55-9a33029ee3cb generation from 0 to 1 during operation: update_inventory {{(pid=74075) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Updating resource provider cc391394-3043-4569-8b55-9a33029ee3cb generation from 1 to 2 during operation: update_traits {{(pid=74075) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.931s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.service [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Creating RPC server for service compute {{(pid=74075) start /opt/stack/nova/nova/service.py:182}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.service [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] Join ServiceGroup membership for this service compute {{(pid=74075) start /opt/stack/nova/nova/service.py:199}}
Oct 26 09:19:50 user nova-compute[74075]: DEBUG nova.servicegroup.drivers.db [None req-de6b846a-d6a6-4542-971d-6bad8ad90e33 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74075) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:20:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:20:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:20:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:20:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=10251MB free_disk=26.163002014160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:20:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:21:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:21:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=10310MB free_disk=26.227134704589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:21:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:22:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:22:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:22:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:22:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:22:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:22:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=10292MB free_disk=25.980716705322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:22:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:22:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:23:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:23:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9572MB free_disk=26.001079559326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:23:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:23:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:23:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:23:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:23:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:23:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:23:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:23:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:23:59 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:23:59 user nova-compute[74075]: INFO nova.compute.claims [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Claim successful on node user
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Creating image(s)
Oct 26 09:24:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.policy [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d86b9184a1410db33192820885da0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453d88800e642b98d9b66dde5fe2e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "839ef064-055b-4050-9c92-8913891abfe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.virt.images [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] dfb66725-6124-42bd-9a80-fc5728283531 was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.part /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:01 user nova-compute[74075]: INFO nova.compute.claims [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Claim successful on node user
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.part /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.converted" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.058s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:01 user nova-compute[74075]: INFO oslo.privsep.daemon [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpuexv7xmf/privsep.sock']
Oct 26 09:24:01 user sudo[83326]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpuexv7xmf/privsep.sock
Oct 26 09:24:01 user sudo[83326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 09:24:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.policy [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d86b9184a1410db33192820885da0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453d88800e642b98d9b66dde5fe2e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Creating image(s)
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:02 user nova-compute[74075]: INFO nova.compute.claims [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Claim successful on node user
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.355s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:02 user nova-compute[74075]: INFO nova.compute.claims [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Claim successful on node user
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Creating image(s)
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:03 user sudo[83326]: pam_unix(sudo:session): session closed for user root
Oct 26 09:24:03 user nova-compute[74075]: INFO oslo.privsep.daemon [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Spawned new privsep daemon via rootwrap
Oct 26 09:24:03 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 09:24:03 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 09:24:03 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 26 09:24:03 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83332
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.policy [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '454822c8719441388cd38cd86b736b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c09f49b38ff4e4f96fa233d1c8e33f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:03 user nova-compute[74075]: WARNING oslo_privsep.priv_context [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] privsep daemon already running
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:03 user nova-compute[74075]: WARNING oslo_privsep.priv_context [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] privsep daemon already running
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Creating image(s)
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "/opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "/opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.policy [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fb92f5c0c0147bdb439ef6456fc30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f470d22e854b1cb2b1f102504eb137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Successfully created port: a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk 1073741824" returned: 0 in 0.057s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.245s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk 1073741824" returned: 0 in 0.157s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.613s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Cannot resize image /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Ensure instance console log exists: /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk 1073741824" returned: 0 in 0.039s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.795s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Cannot resize image /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Ensure instance console log exists: /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.205s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.219s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk 1073741824" returned: 0 in 0.046s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Cannot resize image /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Ensure instance console log exists: /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Cannot resize image /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Ensure instance console log exists: /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Successfully created port: bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Successfully created port: 48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Successfully updated port: a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-changed-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Refreshing instance network info cache due to event network-changed-a73df641-2c14-4ee8-b7fb-f0e08c11a445. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Successfully created port: bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance network_info: |[{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.network.neutron [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Refreshing network info cache for port a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Start _get_guest_xml network_info=[{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:07 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:07 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1620232250',display_name='tempest-ServerRescueNegativeTestJSON-server-1620232250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1620232250',id=1,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-0iyo9h64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:01Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=8999f490-1fc8-443a-bfaa-6a580681f2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:07 user nova-compute[74075]: DEBUG nova.objects.instance [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'pci_devices' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:08 user nova-compute[74075]:   <uuid>8999f490-1fc8-443a-bfaa-6a580681f2b8</uuid>
Oct 26 09:24:08 user nova-compute[74075]:   <name>instance-00000001</name>
Oct 26 09:24:08 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:08 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:08 user nova-compute[74075]:   <metadata>
Oct 26 09:24:08 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:08 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:08 user nova-compute[74075]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1620232250</nova:name>
Oct 26 09:24:08 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:07</nova:creationTime>
Oct 26 09:24:08 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:08 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:08 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:08 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:user uuid="82d86b9184a1410db33192820885da0f">tempest-ServerRescueNegativeTestJSON-336149992-project-member</nova:user>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:project uuid="e453d88800e642b98d9b66dde5fe2e73">tempest-ServerRescueNegativeTestJSON-336149992</nova:project>
Oct 26 09:24:08 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:08 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:08 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:08 user nova-compute[74075]:         <nova:port uuid="a73df641-2c14-4ee8-b7fb-f0e08c11a445">
Oct 26 09:24:08 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:24:08 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:08 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:08 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:08 user nova-compute[74075]:   </metadata>
Oct 26 09:24:08 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:08 user nova-compute[74075]:     <system>
Oct 26 09:24:08 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:08 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:08 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:08 user nova-compute[74075]:       <entry name="serial">8999f490-1fc8-443a-bfaa-6a580681f2b8</entry>
Oct 26 09:24:08 user nova-compute[74075]:       <entry name="uuid">8999f490-1fc8-443a-bfaa-6a580681f2b8</entry>
Oct 26 09:24:08 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:08 user nova-compute[74075]:     </system>
Oct 26 09:24:08 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:08 user nova-compute[74075]:   <os>
Oct 26 09:24:08 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:08 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:08 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:08 user nova-compute[74075]:   </os>
Oct 26 09:24:08 user nova-compute[74075]:   <features>
Oct 26 09:24:08 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:08 user nova-compute[74075]:     <apic/>
Oct 26 09:24:08 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:08 user nova-compute[74075]:   </features>
Oct 26 09:24:08 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:08 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:08 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:08 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:08 user nova-compute[74075]:   </clock>
Oct 26 09:24:08 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:08 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:08 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:08 user nova-compute[74075]:   </cpu>
Oct 26 09:24:08 user nova-compute[74075]:   <devices>
Oct 26 09:24:08 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:08 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:08 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk"/>
Oct 26 09:24:08 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:08 user nova-compute[74075]:     </disk>
Oct 26 09:24:08 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:08 user nova-compute[74075]:       <mac address="fa:16:3e:24:18:70"/>
Oct 26 09:24:08 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:08 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:08 user nova-compute[74075]:       <target dev="tapa73df641-2c"/>
Oct 26 09:24:08 user nova-compute[74075]:     </interface>
Oct 26 09:24:08 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:08 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/console.log" append="off"/>
Oct 26 09:24:08 user nova-compute[74075]:     </serial>
Oct 26 09:24:08 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:08 user nova-compute[74075]:     <video>
Oct 26 09:24:08 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:08 user nova-compute[74075]:     </video>
Oct 26 09:24:08 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:08 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:08 user nova-compute[74075]:     </rng>
Oct 26 09:24:08 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:08 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:08 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:08 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:08 user nova-compute[74075]:   </devices>
Oct 26 09:24:08 user nova-compute[74075]: </domain>
Oct 26 09:24:08 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1620232250',display_name='tempest-ServerRescueNegativeTestJSON-server-1620232250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1620232250',id=1,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-0iyo9h64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:01Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=8999f490-1fc8-443a-bfaa-6a580681f2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG os_vif [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Created schema index Interface.name {{(pid=74075) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Created schema index Port.name {{(pid=74075) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Created schema index Bridge.name {{(pid=74075) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [POLLOUT] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9ee4950-ef14-580c-b533-1464be920741', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:08 user nova-compute[74075]: INFO oslo.privsep.daemon [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpc4lr4vv7/privsep.sock']
Oct 26 09:24:08 user sudo[83430]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpc4lr4vv7/privsep.sock
Oct 26 09:24:08 user sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Successfully updated port: 48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquired lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Successfully updated port: bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-changed-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Refreshing instance network info cache due to event network-changed-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] Acquiring lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-changed-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Refreshing instance network info cache due to event network-changed-48f496fc-e8b1-4065-b6a7-9c2e7512be56. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] Acquiring lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updated VIF entry in instance network info cache for port a73df641-2c14-4ee8-b7fb-f0e08c11a445. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-63fa3992-6d9e-4875-b603-21bab9eab781 req-08b8d868-53f1-4c3b-ab5c-48a8b191696f service nova] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating instance_info_cache with network_info: [{"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Releasing lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Instance network_info: |[{"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] Acquired lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Refreshing network info cache for port 48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Start _get_guest_xml network_info=[{"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1471145056',display_name='tempest-ServerStableDeviceRescueTest-server-1471145056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1471145056',id=3,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN+CPI+22HNzEUiu/bAeKJpY4WCCfNA62AUrMC4cMKsdV+f2WIRKP6BPAQPyltGs+73Xrt3TrglGfm4Iprdu21NYil7j8FSwmQKmpllJ2WKHmzIbUh6dHrhZXvzsnB+uw==',key_name='tempest-keypair-1180237628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f470d22e854b1cb2b1f102504eb137',ramdisk_id='',reservation_id='r-21a3b6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-682475271',owner_user_name='tempest-ServerStableDeviceRescueTest-682475271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb92f5c0c0147bdb439ef6456fc30a8',uuid=5b47826e-624e-4045-b5bc-2b764caf3d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Converting VIF {"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b47826e-624e-4045-b5bc-2b764caf3d25 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:09 user nova-compute[74075]:   <uuid>5b47826e-624e-4045-b5bc-2b764caf3d25</uuid>
Oct 26 09:24:09 user nova-compute[74075]:   <name>instance-00000003</name>
Oct 26 09:24:09 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:09 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:09 user nova-compute[74075]:   <metadata>
Oct 26 09:24:09 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:09 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:09 user nova-compute[74075]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1471145056</nova:name>
Oct 26 09:24:09 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:09</nova:creationTime>
Oct 26 09:24:09 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:09 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:09 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:09 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:user uuid="9fb92f5c0c0147bdb439ef6456fc30a8">tempest-ServerStableDeviceRescueTest-682475271-project-member</nova:user>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:project uuid="b9f470d22e854b1cb2b1f102504eb137">tempest-ServerStableDeviceRescueTest-682475271</nova:project>
Oct 26 09:24:09 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:09 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:09 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:09 user nova-compute[74075]:         <nova:port uuid="48f496fc-e8b1-4065-b6a7-9c2e7512be56">
Oct 26 09:24:09 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 09:24:09 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:09 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:09 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:09 user nova-compute[74075]:   </metadata>
Oct 26 09:24:09 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:09 user nova-compute[74075]:     <system>
Oct 26 09:24:09 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:09 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:09 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:09 user nova-compute[74075]:       <entry name="serial">5b47826e-624e-4045-b5bc-2b764caf3d25</entry>
Oct 26 09:24:09 user nova-compute[74075]:       <entry name="uuid">5b47826e-624e-4045-b5bc-2b764caf3d25</entry>
Oct 26 09:24:09 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:09 user nova-compute[74075]:     </system>
Oct 26 09:24:09 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:09 user nova-compute[74075]:   <os>
Oct 26 09:24:09 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:09 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:09 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:09 user nova-compute[74075]:   </os>
Oct 26 09:24:09 user nova-compute[74075]:   <features>
Oct 26 09:24:09 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:09 user nova-compute[74075]:     <apic/>
Oct 26 09:24:09 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:09 user nova-compute[74075]:   </features>
Oct 26 09:24:09 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:09 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:09 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:09 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:09 user nova-compute[74075]:   </clock>
Oct 26 09:24:09 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:09 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:09 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:09 user nova-compute[74075]:   </cpu>
Oct 26 09:24:09 user nova-compute[74075]:   <devices>
Oct 26 09:24:09 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:09 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:09 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk"/>
Oct 26 09:24:09 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:09 user nova-compute[74075]:     </disk>
Oct 26 09:24:09 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:09 user nova-compute[74075]:       <mac address="fa:16:3e:89:99:4c"/>
Oct 26 09:24:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:09 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:09 user nova-compute[74075]:       <target dev="tap48f496fc-e8"/>
Oct 26 09:24:09 user nova-compute[74075]:     </interface>
Oct 26 09:24:09 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:09 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/console.log" append="off"/>
Oct 26 09:24:09 user nova-compute[74075]:     </serial>
Oct 26 09:24:09 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:09 user nova-compute[74075]:     <video>
Oct 26 09:24:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:09 user nova-compute[74075]:     </video>
Oct 26 09:24:09 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:09 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:09 user nova-compute[74075]:     </rng>
Oct 26 09:24:09 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:09 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:09 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:09 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:09 user nova-compute[74075]:   </devices>
Oct 26 09:24:09 user nova-compute[74075]: </domain>
Oct 26 09:24:09 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1471145056',display_name='tempest-ServerStableDeviceRescueTest-server-1471145056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1471145056',id=3,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN+CPI+22HNzEUiu/bAeKJpY4WCCfNA62AUrMC4cMKsdV+f2WIRKP6BPAQPyltGs+73Xrt3TrglGfm4Iprdu21NYil7j8FSwmQKmpllJ2WKHmzIbUh6dHrhZXvzsnB+uw==',key_name='tempest-keypair-1180237628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f470d22e854b1cb2b1f102504eb137',ramdisk_id='',reservation_id='r-21a3b6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-682475271',owner_user_name='tempest-ServerStableDeviceRescueTest-682475271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb92f5c0c0147bdb439ef6456fc30a8',uuid=5b47826e-624e-4045-b5bc-2b764caf3d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Converting VIF {"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG os_vif [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dad3297-c435-5366-8da9-8b933b2313bf', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Successfully updated port: bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:09 user sudo[83430]: pam_unix(sudo:session): session closed for user root
Oct 26 09:24:10 user nova-compute[74075]: INFO oslo.privsep.daemon [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Spawned new privsep daemon via rootwrap
Oct 26 09:24:10 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 09:24:10 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 09:24:10 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 26 09:24:10 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83433
Oct 26 09:24:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:10 user nova-compute[74075]: WARNING oslo_privsep.priv_context [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] privsep daemon already running
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance network_info: |[{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] Acquired lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Refreshing network info cache for port bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Start _get_guest_xml network_info=[{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:10 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:10 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1379992131',display_name='tempest-ServerRescueNegativeTestJSON-server-1379992131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1379992131',id=2,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-2bwn082t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:02Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=839ef064-055b-4050-9c92-8913891abfe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.objects.instance [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'pci_devices' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:10 user nova-compute[74075]:   <uuid>839ef064-055b-4050-9c92-8913891abfe3</uuid>
Oct 26 09:24:10 user nova-compute[74075]:   <name>instance-00000002</name>
Oct 26 09:24:10 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:10 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:10 user nova-compute[74075]:   <metadata>
Oct 26 09:24:10 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:10 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:10 user nova-compute[74075]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1379992131</nova:name>
Oct 26 09:24:10 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:10</nova:creationTime>
Oct 26 09:24:10 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:10 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:10 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:10 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:user uuid="82d86b9184a1410db33192820885da0f">tempest-ServerRescueNegativeTestJSON-336149992-project-member</nova:user>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:project uuid="e453d88800e642b98d9b66dde5fe2e73">tempest-ServerRescueNegativeTestJSON-336149992</nova:project>
Oct 26 09:24:10 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:10 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:10 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:10 user nova-compute[74075]:         <nova:port uuid="bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9">
Oct 26 09:24:10 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 09:24:10 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:10 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:10 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:10 user nova-compute[74075]:   </metadata>
Oct 26 09:24:10 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:10 user nova-compute[74075]:     <system>
Oct 26 09:24:10 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:10 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:10 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:10 user nova-compute[74075]:       <entry name="serial">839ef064-055b-4050-9c92-8913891abfe3</entry>
Oct 26 09:24:10 user nova-compute[74075]:       <entry name="uuid">839ef064-055b-4050-9c92-8913891abfe3</entry>
Oct 26 09:24:10 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:10 user nova-compute[74075]:     </system>
Oct 26 09:24:10 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:10 user nova-compute[74075]:   <os>
Oct 26 09:24:10 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:10 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:10 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:10 user nova-compute[74075]:   </os>
Oct 26 09:24:10 user nova-compute[74075]:   <features>
Oct 26 09:24:10 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:10 user nova-compute[74075]:     <apic/>
Oct 26 09:24:10 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:10 user nova-compute[74075]:   </features>
Oct 26 09:24:10 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:10 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:10 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:10 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:10 user nova-compute[74075]:   </clock>
Oct 26 09:24:10 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:10 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:10 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:10 user nova-compute[74075]:   </cpu>
Oct 26 09:24:10 user nova-compute[74075]:   <devices>
Oct 26 09:24:10 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:10 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:10 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk"/>
Oct 26 09:24:10 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:10 user nova-compute[74075]:     </disk>
Oct 26 09:24:10 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:10 user nova-compute[74075]:       <mac address="fa:16:3e:b9:b5:9b"/>
Oct 26 09:24:10 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:10 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:10 user nova-compute[74075]:       <target dev="tapbacc94ad-3b"/>
Oct 26 09:24:10 user nova-compute[74075]:     </interface>
Oct 26 09:24:10 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:10 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/console.log" append="off"/>
Oct 26 09:24:10 user nova-compute[74075]:     </serial>
Oct 26 09:24:10 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:10 user nova-compute[74075]:     <video>
Oct 26 09:24:10 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:10 user nova-compute[74075]:     </video>
Oct 26 09:24:10 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:10 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:10 user nova-compute[74075]:     </rng>
Oct 26 09:24:10 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:10 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:10 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:10 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:10 user nova-compute[74075]:   </devices>
Oct 26 09:24:10 user nova-compute[74075]: </domain>
Oct 26 09:24:10 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1379992131',display_name='tempest-ServerRescueNegativeTestJSON-server-1379992131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1379992131',id=2,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-2bwn082t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:02Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=839ef064-055b-4050-9c92-8913891abfe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG os_vif [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b871f6-4ac8-5d22-b4f3-00c6b363735a', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48f496fc-e8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48f496fc-e8, col_values=(('qos', UUID('53c7b96c-a402-4c6d-862d-3d4f129a7124')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48f496fc-e8, col_values=(('external_ids', {'iface-id': '48f496fc-e8b1-4065-b6a7-9c2e7512be56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:99:4c', 'vm-uuid': '5b47826e-624e-4045-b5bc-2b764caf3d25'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: INFO os_vif [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8')
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73df641-2c, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa73df641-2c, col_values=(('qos', UUID('c45aef73-81e1-4cc4-acb4-cdc694db33a1')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa73df641-2c, col_values=(('external_ids', {'iface-id': 'a73df641-2c14-4ee8-b7fb-f0e08c11a445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:18:70', 'vm-uuid': '8999f490-1fc8-443a-bfaa-6a580681f2b8'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: INFO os_vif [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c')
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbacc94ad-3b, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbacc94ad-3b, col_values=(('qos', UUID('2bdb979d-388e-44a4-8f1f-1a73437d84b1')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbacc94ad-3b, col_values=(('external_ids', {'iface-id': 'bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:b5:9b', 'vm-uuid': '839ef064-055b-4050-9c92-8913891abfe3'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:10 user nova-compute[74075]: INFO os_vif [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b')
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] No VIF found with MAC fa:16:3e:89:99:4c, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updated VIF entry in instance network info cache for port 48f496fc-e8b1-4065-b6a7-9c2e7512be56. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating instance_info_cache with network_info: [{"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:24:18:70, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-829e588f-83cd-4546-897f-6b7e6fe5691a req-c07dea70-3104-47de-8bf5-65a92ae22f18 service nova] Releasing lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:b9:b5:9b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-changed-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Refreshing instance network info cache due to event network-changed-bbf845ec-94f6-4489-a12d-2bc5cca19e8a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance network_info: |[{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Refreshing network info cache for port bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start _get_guest_xml network_info=[{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:11 user nova-compute[74075]: INFO nova.compute.claims [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Claim successful on node user
Oct 26 09:24:11 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:11 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'pci_devices' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:11 user nova-compute[74075]:   <uuid>e4baa273-79c9-408c-9c41-17e202582246</uuid>
Oct 26 09:24:11 user nova-compute[74075]:   <name>instance-00000004</name>
Oct 26 09:24:11 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:11 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:11 user nova-compute[74075]:   <metadata>
Oct 26 09:24:11 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:11 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:11 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeTestJSON-server-650728468</nova:name>
Oct 26 09:24:11 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:11</nova:creationTime>
Oct 26 09:24:11 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:11 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:11 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:11 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:user uuid="454822c8719441388cd38cd86b736b3c">tempest-AttachVolumeTestJSON-1598575575-project-member</nova:user>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:project uuid="4c09f49b38ff4e4f96fa233d1c8e33f4">tempest-AttachVolumeTestJSON-1598575575</nova:project>
Oct 26 09:24:11 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:11 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:11 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:11 user nova-compute[74075]:         <nova:port uuid="bbf845ec-94f6-4489-a12d-2bc5cca19e8a">
Oct 26 09:24:11 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:24:11 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:11 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:11 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:11 user nova-compute[74075]:   </metadata>
Oct 26 09:24:11 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:11 user nova-compute[74075]:     <system>
Oct 26 09:24:11 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:11 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:11 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:11 user nova-compute[74075]:       <entry name="serial">e4baa273-79c9-408c-9c41-17e202582246</entry>
Oct 26 09:24:11 user nova-compute[74075]:       <entry name="uuid">e4baa273-79c9-408c-9c41-17e202582246</entry>
Oct 26 09:24:11 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:11 user nova-compute[74075]:     </system>
Oct 26 09:24:11 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:11 user nova-compute[74075]:   <os>
Oct 26 09:24:11 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:11 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:11 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:11 user nova-compute[74075]:   </os>
Oct 26 09:24:11 user nova-compute[74075]:   <features>
Oct 26 09:24:11 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:11 user nova-compute[74075]:     <apic/>
Oct 26 09:24:11 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:11 user nova-compute[74075]:   </features>
Oct 26 09:24:11 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:11 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:11 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:11 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:11 user nova-compute[74075]:   </clock>
Oct 26 09:24:11 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:11 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:11 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:11 user nova-compute[74075]:   </cpu>
Oct 26 09:24:11 user nova-compute[74075]:   <devices>
Oct 26 09:24:11 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:11 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:11 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk"/>
Oct 26 09:24:11 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:11 user nova-compute[74075]:     </disk>
Oct 26 09:24:11 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:11 user nova-compute[74075]:       <mac address="fa:16:3e:b5:b5:5b"/>
Oct 26 09:24:11 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:11 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:11 user nova-compute[74075]:       <target dev="tapbbf845ec-94"/>
Oct 26 09:24:11 user nova-compute[74075]:     </interface>
Oct 26 09:24:11 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:11 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/console.log" append="off"/>
Oct 26 09:24:11 user nova-compute[74075]:     </serial>
Oct 26 09:24:11 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:11 user nova-compute[74075]:     <video>
Oct 26 09:24:11 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:11 user nova-compute[74075]:     </video>
Oct 26 09:24:11 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:11 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:11 user nova-compute[74075]:     </rng>
Oct 26 09:24:11 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:11 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:11 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:11 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:11 user nova-compute[74075]:   </devices>
Oct 26 09:24:11 user nova-compute[74075]: </domain>
Oct 26 09:24:11 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG os_vif [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '612fcdba-9c77-5adb-839c-f977216dfdee', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbf845ec-94, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbf845ec-94, col_values=(('qos', UUID('09f3ea2f-bf32-415d-95c7-b680adb18927')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbf845ec-94, col_values=(('external_ids', {'iface-id': 'bbf845ec-94f6-4489-a12d-2bc5cca19e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b5:5b', 'vm-uuid': 'e4baa273-79c9-408c-9c41-17e202582246'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:11 user nova-compute[74075]: INFO os_vif [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94')
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updated VIF entry in instance network info cache for port bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No VIF found with MAC fa:16:3e:b5:b5:5b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e12f8f8c-5b51-4e14-ba4f-2ffef8ebf0cf req-0b47c2c4-e25c-4385-ab62-90a309dd0452 service nova] Releasing lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:12 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:12 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Creating image(s)
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "/opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "/opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "/opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.policy [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1003917645d47fa97204a5120eccadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f45c95858d242088d115e4e062f1c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.272s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk 1073741824" returned: 0 in 0.064s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.network.neutron [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updated VIF entry in instance network info cache for port bbf845ec-94f6-4489-a12d-2bc5cca19e8a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG nova.network.neutron [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-765a7697-3f22-46d2-b1cf-cb68e1e3c379 req-d1974d72-9288-42b9-9567-2bd1c31ac9d1 service nova] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Cannot resize image /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Ensure instance console log exists: /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Successfully created port: c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Successfully updated port: c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquired lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-changed-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Refreshing instance network info cache due to event network-changed-c82c639c-ebc3-4b59-926b-f5e1ae424576. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] Acquiring lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating instance_info_cache with network_info: [{"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Releasing lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Instance network_info: |[{"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] Acquired lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Refreshing network info cache for port c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Start _get_guest_xml network_info=[{"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1765329378',display_name='tempest-VolumesAdminNegativeTest-server-1765329378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1765329378',id=5,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIg0UrD9IUlnMUY4/40eum5PCLSTy/5gxF1H+FCVBEkxUmFBVsrL71Ec1NZXF6DUOwUZAhw7edf2fxVTg6qXvH2wvyKm6CsIXDrZk9aGJOO9I/MjZglqkXQqG8VPW3j0Q==',key_name='tempest-keypair-53060570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f45c95858d242088d115e4e062f1c55',ramdisk_id='',reservation_id='r-gmci10gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1450530067',owner_user_name='tempest-VolumesAdminNegativeTest-1450530067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1003917645d47fa97204a5120eccadf',uuid=17b8e7c7-a424-4101-86eb-c62708543f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converting VIF {"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.objects.instance [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'pci_devices' on Instance uuid 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:15 user nova-compute[74075]:   <uuid>17b8e7c7-a424-4101-86eb-c62708543f06</uuid>
Oct 26 09:24:15 user nova-compute[74075]:   <name>instance-00000005</name>
Oct 26 09:24:15 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:15 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:15 user nova-compute[74075]:   <metadata>
Oct 26 09:24:15 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:15 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:15 user nova-compute[74075]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1765329378</nova:name>
Oct 26 09:24:15 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:15</nova:creationTime>
Oct 26 09:24:15 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:15 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:15 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:15 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:user uuid="c1003917645d47fa97204a5120eccadf">tempest-VolumesAdminNegativeTest-1450530067-project-member</nova:user>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:project uuid="9f45c95858d242088d115e4e062f1c55">tempest-VolumesAdminNegativeTest-1450530067</nova:project>
Oct 26 09:24:15 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:15 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:15 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:15 user nova-compute[74075]:         <nova:port uuid="c82c639c-ebc3-4b59-926b-f5e1ae424576">
Oct 26 09:24:15 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:24:15 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:15 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:15 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:15 user nova-compute[74075]:   </metadata>
Oct 26 09:24:15 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:15 user nova-compute[74075]:     <system>
Oct 26 09:24:15 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:15 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:15 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:15 user nova-compute[74075]:       <entry name="serial">17b8e7c7-a424-4101-86eb-c62708543f06</entry>
Oct 26 09:24:15 user nova-compute[74075]:       <entry name="uuid">17b8e7c7-a424-4101-86eb-c62708543f06</entry>
Oct 26 09:24:15 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:15 user nova-compute[74075]:     </system>
Oct 26 09:24:15 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:15 user nova-compute[74075]:   <os>
Oct 26 09:24:15 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:15 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:15 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:15 user nova-compute[74075]:   </os>
Oct 26 09:24:15 user nova-compute[74075]:   <features>
Oct 26 09:24:15 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:15 user nova-compute[74075]:     <apic/>
Oct 26 09:24:15 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:15 user nova-compute[74075]:   </features>
Oct 26 09:24:15 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:15 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:15 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:15 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:15 user nova-compute[74075]:   </clock>
Oct 26 09:24:15 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:15 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:15 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:15 user nova-compute[74075]:   </cpu>
Oct 26 09:24:15 user nova-compute[74075]:   <devices>
Oct 26 09:24:15 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:15 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:15 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk"/>
Oct 26 09:24:15 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:15 user nova-compute[74075]:     </disk>
Oct 26 09:24:15 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:15 user nova-compute[74075]:       <mac address="fa:16:3e:b3:a0:77"/>
Oct 26 09:24:15 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:15 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:15 user nova-compute[74075]:       <target dev="tapc82c639c-eb"/>
Oct 26 09:24:15 user nova-compute[74075]:     </interface>
Oct 26 09:24:15 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:15 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/console.log" append="off"/>
Oct 26 09:24:15 user nova-compute[74075]:     </serial>
Oct 26 09:24:15 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:15 user nova-compute[74075]:     <video>
Oct 26 09:24:15 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:15 user nova-compute[74075]:     </video>
Oct 26 09:24:15 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:15 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:15 user nova-compute[74075]:     </rng>
Oct 26 09:24:15 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:15 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:15 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:15 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:15 user nova-compute[74075]:   </devices>
Oct 26 09:24:15 user nova-compute[74075]: </domain>
Oct 26 09:24:15 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1765329378',display_name='tempest-VolumesAdminNegativeTest-server-1765329378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1765329378',id=5,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIg0UrD9IUlnMUY4/40eum5PCLSTy/5gxF1H+FCVBEkxUmFBVsrL71Ec1NZXF6DUOwUZAhw7edf2fxVTg6qXvH2wvyKm6CsIXDrZk9aGJOO9I/MjZglqkXQqG8VPW3j0Q==',key_name='tempest-keypair-53060570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f45c95858d242088d115e4e062f1c55',ramdisk_id='',reservation_id='r-gmci10gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1450530067',owner_user_name='tempest-VolumesAdminNegativeTest-1450530067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1003917645d47fa97204a5120eccadf',uuid=17b8e7c7-a424-4101-86eb-c62708543f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converting VIF {"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG os_vif [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5202e64c-9fca-58a3-8468-95eae2786d9a', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc82c639c-eb, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc82c639c-eb, col_values=(('qos', UUID('086908ac-26d8-4259-b9ba-dd91ab5a4efb')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc82c639c-eb, col_values=(('external_ids', {'iface-id': 'c82c639c-ebc3-4b59-926b-f5e1ae424576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:a0:77', 'vm-uuid': '17b8e7c7-a424-4101-86eb-c62708543f06'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:15 user nova-compute[74075]: INFO os_vif [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb')
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No VIF found with MAC fa:16:3e:b3:a0:77, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updated VIF entry in instance network info cache for port c82c639c-ebc3-4b59-926b-f5e1ae424576. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating instance_info_cache with network_info: [{"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-46063b3a-034f-4ed0-83b7-46eb39bbb5e9 req-a4f4f9e3-cdd0-457c-abf3-1131062e31f4 service nova] Releasing lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-e22b0183-2cad-48fe-90db-e99c7a6ff378 req-3e3df9c1-dd97-4601-9be9-39b39a79abd0 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e22b0183-2cad-48fe-90db-e99c7a6ff378 req-3e3df9c1-dd97-4601-9be9-39b39a79abd0 service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e22b0183-2cad-48fe-90db-e99c7a6ff378 req-3e3df9c1-dd97-4601-9be9-39b39a79abd0 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e22b0183-2cad-48fe-90db-e99c7a6ff378 req-3e3df9c1-dd97-4601-9be9-39b39a79abd0 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-e22b0183-2cad-48fe-90db-e99c7a6ff378 req-3e3df9c1-dd97-4601-9be9-39b39a79abd0 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:19 user nova-compute[74075]: WARNING nova.compute.manager [req-e22b0183-2cad-48fe-90db-e99c7a6ff378 req-3e3df9c1-dd97-4601-9be9-39b39a79abd0 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state building and task_state spawning.
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:20 user nova-compute[74075]: INFO nova.compute.claims [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Claim successful on node user
Oct 26 09:24:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance spawned successfully.
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:20 user nova-compute[74075]: INFO nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Took 18.06 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:20 user nova-compute[74075]: INFO nova.compute.manager [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Took 19.07 seconds to build instance.
Oct 26 09:24:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcf83667-c85c-4152-9d89-642718bd924c tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "839ef064-055b-4050-9c92-8913891abfe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.217s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.519s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Instance spawned successfully.
Oct 26 09:24:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance spawned successfully.
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance spawned successfully.
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Took 17.73 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Took 18.15 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Creating image(s)
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "/opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "/opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "032f4610a2cc20412c3157fe1ff6ee2160e93c72" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "032f4610a2cc20412c3157fe1ff6ee2160e93c72" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Took 20.68 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.policy [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea5ca8417e704477a68d980ca2725aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad3a815bd24e2c97ad00d409dc7847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ec84f30-87ef-41c4-a248-9f69c00c4bcd req-9f7f9233-6c4a-4b51-a12d-217820bbcd53 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ec84f30-87ef-41c4-a248-9f69c00c4bcd req-9f7f9233-6c4a-4b51-a12d-217820bbcd53 service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ec84f30-87ef-41c4-a248-9f69c00c4bcd req-9f7f9233-6c4a-4b51-a12d-217820bbcd53 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ec84f30-87ef-41c4-a248-9f69c00c4bcd req-9f7f9233-6c4a-4b51-a12d-217820bbcd53 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ec84f30-87ef-41c4-a248-9f69c00c4bcd req-9f7f9233-6c4a-4b51-a12d-217820bbcd53 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:21 user nova-compute[74075]: WARNING nova.compute.manager [req-8ec84f30-87ef-41c4-a248-9f69c00c4bcd req-9f7f9233-6c4a-4b51-a12d-217820bbcd53 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state active and task_state None.
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.compute.manager [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Took 19.25 seconds to build instance.
Oct 26 09:24:21 user nova-compute[74075]: INFO nova.compute.manager [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Took 19.37 seconds to build instance.
Oct 26 09:24:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-24a04106-3bea-4c8f-b236-92a9df37d75a tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.405s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b8cb1d3-de93-4037-9021-c17543996f98 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.067s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:22 user nova-compute[74075]: INFO nova.compute.manager [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Took 22.37 seconds to build instance.
Oct 26 09:24:22 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Instance spawned successfully.
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bf744b6f-03a8-4cdd-aa4a-362a4fc8cd91 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.743s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:22 user nova-compute[74075]: INFO nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Took 10.14 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.part --force-share --output=json" returned: 0 in 0.426s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.virt.images [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] 78a3355a-ab91-43b7-9d6a-6084b2c2df2b was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:24:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.part /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:22 user nova-compute[74075]: INFO nova.compute.manager [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Took 11.25 seconds to build instance.
Oct 26 09:24:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0adb0892-7ebe-49e5-8708-0c9c7a8ad564 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.614s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.part /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.converted" returned: 0 in 0.660s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72.converted --force-share --output=json" returned: 0 in 0.470s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "032f4610a2cc20412c3157fe1ff6ee2160e93c72" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.249s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.010s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:23 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Successfully created port: 410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 --force-share --output=json" returned: 0 in 0.315s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "032f4610a2cc20412c3157fe1ff6ee2160e93c72" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "032f4610a2cc20412c3157fe1ff6ee2160e93c72" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:24 user nova-compute[74075]: INFO nova.compute.claims [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Claim successful on node user
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 --force-share --output=json" returned: 0 in 0.285s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72,backing_fmt=raw /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72,backing_fmt=raw /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk 1073741824" returned: 0 in 0.113s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "032f4610a2cc20412c3157fe1ff6ee2160e93c72" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 --force-share --output=json" returned: 0 in 0.349s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Cannot resize image /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Ensure instance console log exists: /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.220s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:25 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.policy [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c15f18b959d41939d56108d7e5bd4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b08100469d43a88508707a8e6d2a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Successfully updated port: 410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquired lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-changed-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Refreshing instance network info cache due to event network-changed-410accba-c082-4e57-98ac-02e80c2d76a0. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] Acquiring lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:26 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Creating image(s)
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "/opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "/opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "/opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.434s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.302s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk 1073741824" returned: 0 in 0.084s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updating instance_info_cache with network_info: [{"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Releasing lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Instance network_info: |[{"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] Acquired lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.network.neutron [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Refreshing network info cache for port 410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Start _get_guest_xml network_info=[{"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:24:13Z,direct_url=<?>,disk_format='qcow2',id=78a3355a-ab91-43b7-9d6a-6084b2c2df2b,min_disk=0,min_ram=0,name='',owner='de6eef3b74cd46b4abf495383db00e47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:24:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': '78a3355a-ab91-43b7-9d6a-6084b2c2df2b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:27 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:27 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:24:13Z,direct_url=<?>,disk_format='qcow2',id=78a3355a-ab91-43b7-9d6a-6084b2c2df2b,min_disk=0,min_ram=0,name='',owner='de6eef3b74cd46b4abf495383db00e47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:24:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-731410694',display_name='tempest-AttachSCSIVolumeTestJSON-server-731410694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-731410694',id=6,image_ref='78a3355a-ab91-43b7-9d6a-6084b2c2df2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZwsjpzf5ARmw25TSuktTJtkXpbSGy3et+6NhezKyAKhgUyefN4RIz9B6am5UnbhlirdePWonPprzgFpgtqrQF0kjzyrF7DcySxLf1YVuHJ06qafj1zoLyi5Kutb9v5Jg==',key_name='tempest-keypair-2097979517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ad3a815bd24e2c97ad00d409dc7847',ramdisk_id='',reservation_id='r-e9od9dfb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78a3355a-ab91-43b7-9d6a-6084b2c2df2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1397659036',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1397659036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5ca8417e704477a68d980ca2725aa8',uuid=8fde35bc-f050-40fa-8975-b10691739658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Converting VIF {"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fde35bc-f050-40fa-8975-b10691739658 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.361s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:27 user nova-compute[74075]:   <uuid>8fde35bc-f050-40fa-8975-b10691739658</uuid>
Oct 26 09:24:27 user nova-compute[74075]:   <name>instance-00000006</name>
Oct 26 09:24:27 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:27 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:27 user nova-compute[74075]:   <metadata>
Oct 26 09:24:27 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:27 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:27 user nova-compute[74075]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-731410694</nova:name>
Oct 26 09:24:27 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:27</nova:creationTime>
Oct 26 09:24:27 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:27 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:27 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:27 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:user uuid="ea5ca8417e704477a68d980ca2725aa8">tempest-AttachSCSIVolumeTestJSON-1397659036-project-member</nova:user>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:project uuid="62ad3a815bd24e2c97ad00d409dc7847">tempest-AttachSCSIVolumeTestJSON-1397659036</nova:project>
Oct 26 09:24:27 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:27 user nova-compute[74075]:       <nova:root type="image" uuid="78a3355a-ab91-43b7-9d6a-6084b2c2df2b"/>
Oct 26 09:24:27 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:27 user nova-compute[74075]:         <nova:port uuid="410accba-c082-4e57-98ac-02e80c2d76a0">
Oct 26 09:24:27 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 09:24:27 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:27 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:27 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:27 user nova-compute[74075]:   </metadata>
Oct 26 09:24:27 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:27 user nova-compute[74075]:     <system>
Oct 26 09:24:27 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:27 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:27 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:27 user nova-compute[74075]:       <entry name="serial">8fde35bc-f050-40fa-8975-b10691739658</entry>
Oct 26 09:24:27 user nova-compute[74075]:       <entry name="uuid">8fde35bc-f050-40fa-8975-b10691739658</entry>
Oct 26 09:24:27 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:27 user nova-compute[74075]:     </system>
Oct 26 09:24:27 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:27 user nova-compute[74075]:   <os>
Oct 26 09:24:27 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:27 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:27 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:27 user nova-compute[74075]:   </os>
Oct 26 09:24:27 user nova-compute[74075]:   <features>
Oct 26 09:24:27 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:27 user nova-compute[74075]:     <apic/>
Oct 26 09:24:27 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:27 user nova-compute[74075]:   </features>
Oct 26 09:24:27 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:27 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:27 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:27 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:27 user nova-compute[74075]:   </clock>
Oct 26 09:24:27 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:27 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:27 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:27 user nova-compute[74075]:   </cpu>
Oct 26 09:24:27 user nova-compute[74075]:   <devices>
Oct 26 09:24:27 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:27 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:27 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk"/>
Oct 26 09:24:27 user nova-compute[74075]:       <target dev="sda" bus="scsi"/>
Oct 26 09:24:27 user nova-compute[74075]:       <address type="drive" controller="0" unit="0"/>
Oct 26 09:24:27 user nova-compute[74075]:     </disk>
Oct 26 09:24:27 user nova-compute[74075]:     <disk type="file" device="cdrom">
Oct 26 09:24:27 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 09:24:27 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.config"/>
Oct 26 09:24:27 user nova-compute[74075]:       <target dev="sdb" bus="scsi"/>
Oct 26 09:24:27 user nova-compute[74075]:       <address type="drive" controller="0" unit="1"/>
Oct 26 09:24:27 user nova-compute[74075]:     </disk>
Oct 26 09:24:27 user nova-compute[74075]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 26 09:24:27 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:27 user nova-compute[74075]:       <mac address="fa:16:3e:41:1c:d3"/>
Oct 26 09:24:27 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:27 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:27 user nova-compute[74075]:       <target dev="tap410accba-c0"/>
Oct 26 09:24:27 user nova-compute[74075]:     </interface>
Oct 26 09:24:27 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:27 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/console.log" append="off"/>
Oct 26 09:24:27 user nova-compute[74075]:     </serial>
Oct 26 09:24:27 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:27 user nova-compute[74075]:     <video>
Oct 26 09:24:27 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:27 user nova-compute[74075]:     </video>
Oct 26 09:24:27 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:27 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:27 user nova-compute[74075]:     </rng>
Oct 26 09:24:27 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:27 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:27 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:27 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:27 user nova-compute[74075]:   </devices>
Oct 26 09:24:27 user nova-compute[74075]: </domain>
Oct 26 09:24:27 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-731410694',display_name='tempest-AttachSCSIVolumeTestJSON-server-731410694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-731410694',id=6,image_ref='78a3355a-ab91-43b7-9d6a-6084b2c2df2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZwsjpzf5ARmw25TSuktTJtkXpbSGy3et+6NhezKyAKhgUyefN4RIz9B6am5UnbhlirdePWonPprzgFpgtqrQF0kjzyrF7DcySxLf1YVuHJ06qafj1zoLyi5Kutb9v5Jg==',key_name='tempest-keypair-2097979517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ad3a815bd24e2c97ad00d409dc7847',ramdisk_id='',reservation_id='r-e9od9dfb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78a3355a-ab91-43b7-9d6a-6084b2c2df2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1397659036',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1397659036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5ca8417e704477a68d980ca2725aa8',uuid=8fde35bc-f050-40fa-8975-b10691739658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Converting VIF {"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG os_vif [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '355aa817-46ee-540d-bb87-6535ead0f63b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap410accba-c0, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap410accba-c0, col_values=(('qos', UUID('7758fa74-5763-42ee-8055-d3afa7cb3fac')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap410accba-c0, col_values=(('external_ids', {'iface-id': '410accba-c082-4e57-98ac-02e80c2d76a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:1c:d3', 'vm-uuid': '8fde35bc-f050-40fa-8975-b10691739658'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:27 user nova-compute[74075]: INFO os_vif [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0')
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No BDM found with device name sda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No VIF found with MAC fa:16:3e:41:1c:d3, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:27 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Using config drive
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Cannot resize image /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Ensure instance console log exists: /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Successfully created port: 13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updated VIF entry in instance network info cache for port 410accba-c082-4e57-98ac-02e80c2d76a0. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updating instance_info_cache with network_info: [{"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d4a12029-21a9-43b5-b621-9bcc663e5c43 req-356ad4f0-4de7-454d-8153-94d61b1ae554 service nova] Releasing lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-15863d24-5093-4b8d-89ee-45ecb82413a0 req-43e6a32f-8993-4de7-afee-805f2092abf5 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-15863d24-5093-4b8d-89ee-45ecb82413a0 req-43e6a32f-8993-4de7-afee-805f2092abf5 service nova] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-15863d24-5093-4b8d-89ee-45ecb82413a0 req-43e6a32f-8993-4de7-afee-805f2092abf5 service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-15863d24-5093-4b8d-89ee-45ecb82413a0 req-43e6a32f-8993-4de7-afee-805f2092abf5 service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-15863d24-5093-4b8d-89ee-45ecb82413a0 req-43e6a32f-8993-4de7-afee-805f2092abf5 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] No waiting events found dispatching network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:28 user nova-compute[74075]: WARNING nova.compute.manager [req-15863d24-5093-4b8d-89ee-45ecb82413a0 req-43e6a32f-8993-4de7-afee-805f2092abf5 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received unexpected event network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 for instance with vm_state active and task_state None.
Oct 26 09:24:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Creating config drive at /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.config
Oct 26 09:24:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplea2c8fb {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplea2c8fb" returned: 0 in 0.101s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Successfully updated port: 13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquired lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-changed-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Refreshing instance network info cache due to event network-changed-13bbf9da-ac50-405f-a1bb-346c1a79b1c3. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] Acquiring lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updating instance_info_cache with network_info: [{"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Releasing lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Instance network_info: |[{"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] Acquired lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Refreshing network info cache for port 13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Start _get_guest_xml network_info=[{"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:30 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:30 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1660728280',display_name='tempest-TestVolumeSwap-server-1660728280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1660728280',id=7,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnx5NnplzItllHF5/5SOkdepxVb7XWu0bQl3O92OZcCoI5r3YBIOfaoixG03552DwIARQAhesyNsJuqi7nUaZ0viblmOYGJKLvSlZ5uYGEn1DEXy9JH462rAMgikekIjA==',key_name='tempest-keypair-918549677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b08100469d43a88508707a8e6d2a89',ramdisk_id='',reservation_id='r-9moenxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1378683366',owner_user_name='tempest-TestVolumeSwap-1378683366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c15f18b959d41939d56108d7e5bd4c4',uuid=771ed6ed-15e1-40a8-8ad7-f11dd424f4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Converting VIF {"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.objects.instance [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lazy-loading 'pci_devices' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:30 user nova-compute[74075]:   <uuid>771ed6ed-15e1-40a8-8ad7-f11dd424f4a0</uuid>
Oct 26 09:24:30 user nova-compute[74075]:   <name>instance-00000007</name>
Oct 26 09:24:30 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:30 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:30 user nova-compute[74075]:   <metadata>
Oct 26 09:24:30 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:30 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:30 user nova-compute[74075]:       <nova:name>tempest-TestVolumeSwap-server-1660728280</nova:name>
Oct 26 09:24:30 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:30</nova:creationTime>
Oct 26 09:24:30 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:30 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:30 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:30 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:user uuid="5c15f18b959d41939d56108d7e5bd4c4">tempest-TestVolumeSwap-1378683366-project-member</nova:user>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:project uuid="b0b08100469d43a88508707a8e6d2a89">tempest-TestVolumeSwap-1378683366</nova:project>
Oct 26 09:24:30 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:30 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:30 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:30 user nova-compute[74075]:         <nova:port uuid="13bbf9da-ac50-405f-a1bb-346c1a79b1c3">
Oct 26 09:24:30 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:24:30 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:30 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:30 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:30 user nova-compute[74075]:   </metadata>
Oct 26 09:24:30 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:30 user nova-compute[74075]:     <system>
Oct 26 09:24:30 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:30 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:30 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:30 user nova-compute[74075]:       <entry name="serial">771ed6ed-15e1-40a8-8ad7-f11dd424f4a0</entry>
Oct 26 09:24:30 user nova-compute[74075]:       <entry name="uuid">771ed6ed-15e1-40a8-8ad7-f11dd424f4a0</entry>
Oct 26 09:24:30 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:30 user nova-compute[74075]:     </system>
Oct 26 09:24:30 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:30 user nova-compute[74075]:   <os>
Oct 26 09:24:30 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:30 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:30 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:30 user nova-compute[74075]:   </os>
Oct 26 09:24:30 user nova-compute[74075]:   <features>
Oct 26 09:24:30 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:30 user nova-compute[74075]:     <apic/>
Oct 26 09:24:30 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:30 user nova-compute[74075]:   </features>
Oct 26 09:24:30 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:30 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:30 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:30 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:30 user nova-compute[74075]:   </clock>
Oct 26 09:24:30 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:30 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:30 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:30 user nova-compute[74075]:   </cpu>
Oct 26 09:24:30 user nova-compute[74075]:   <devices>
Oct 26 09:24:30 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:30 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:30 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk"/>
Oct 26 09:24:30 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:30 user nova-compute[74075]:     </disk>
Oct 26 09:24:30 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:30 user nova-compute[74075]:       <mac address="fa:16:3e:19:fc:e8"/>
Oct 26 09:24:30 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:30 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:30 user nova-compute[74075]:       <target dev="tap13bbf9da-ac"/>
Oct 26 09:24:30 user nova-compute[74075]:     </interface>
Oct 26 09:24:30 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:30 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/console.log" append="off"/>
Oct 26 09:24:30 user nova-compute[74075]:     </serial>
Oct 26 09:24:30 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:30 user nova-compute[74075]:     <video>
Oct 26 09:24:30 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:30 user nova-compute[74075]:     </video>
Oct 26 09:24:30 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:30 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:30 user nova-compute[74075]:     </rng>
Oct 26 09:24:30 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:30 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:30 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:30 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:30 user nova-compute[74075]:   </devices>
Oct 26 09:24:30 user nova-compute[74075]: </domain>
Oct 26 09:24:30 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1660728280',display_name='tempest-TestVolumeSwap-server-1660728280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1660728280',id=7,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnx5NnplzItllHF5/5SOkdepxVb7XWu0bQl3O92OZcCoI5r3YBIOfaoixG03552DwIARQAhesyNsJuqi7nUaZ0viblmOYGJKLvSlZ5uYGEn1DEXy9JH462rAMgikekIjA==',key_name='tempest-keypair-918549677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b08100469d43a88508707a8e6d2a89',ramdisk_id='',reservation_id='r-9moenxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1378683366',owner_user_name='tempest-TestVolumeSwap-1378683366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c15f18b959d41939d56108d7e5bd4c4',uuid=771ed6ed-15e1-40a8-8ad7-f11dd424f4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Converting VIF {"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG os_vif [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a94e3843-2bb2-5141-9330-f329dcd14d8b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13bbf9da-ac, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13bbf9da-ac, col_values=(('qos', UUID('bfc63015-f526-4039-bf47-2f28797842c4')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13bbf9da-ac, col_values=(('external_ids', {'iface-id': '13bbf9da-ac50-405f-a1bb-346c1a79b1c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:fc:e8', 'vm-uuid': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] No waiting events found dispatching network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:30 user nova-compute[74075]: WARNING nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received unexpected event network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 for instance with vm_state active and task_state None.
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:30 user nova-compute[74075]: WARNING nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state active and task_state None.
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:30 user nova-compute[74075]: WARNING nova.compute.manager [req-b483a693-6de1-40a8-878c-babf4f65d796 req-57ba3d0e-a973-4fe6-97cf-2097c21d3044 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state active and task_state None.
Oct 26 09:24:30 user nova-compute[74075]: INFO os_vif [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac')
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] No VIF found with MAC fa:16:3e:19:fc:e8, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG nova.network.neutron [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updated VIF entry in instance network info cache for port 13bbf9da-ac50-405f-a1bb-346c1a79b1c3. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG nova.network.neutron [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updating instance_info_cache with network_info: [{"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9830e426-8255-4fe4-b0d3-6cf7a4e37c47 req-be2c7862-ceeb-408a-bcb5-fb7d0dbad926 service nova] Releasing lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-db98e5a7-f8b4-4572-af28-c4e00cac6ab9 req-515306ef-c695-4d61-a22d-3a7d2f43f072 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-db98e5a7-f8b4-4572-af28-c4e00cac6ab9 req-515306ef-c695-4d61-a22d-3a7d2f43f072 service nova] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-db98e5a7-f8b4-4572-af28-c4e00cac6ab9 req-515306ef-c695-4d61-a22d-3a7d2f43f072 service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-db98e5a7-f8b4-4572-af28-c4e00cac6ab9 req-515306ef-c695-4d61-a22d-3a7d2f43f072 service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-db98e5a7-f8b4-4572-af28-c4e00cac6ab9 req-515306ef-c695-4d61-a22d-3a7d2f43f072 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] No waiting events found dispatching network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:31 user nova-compute[74075]: WARNING nova.compute.manager [req-db98e5a7-f8b4-4572-af28-c4e00cac6ab9 req-515306ef-c695-4d61-a22d-3a7d2f43f072 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received unexpected event network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 for instance with vm_state building and task_state spawning.
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:31 user nova-compute[74075]: INFO nova.compute.claims [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Claim successful on node user
Oct 26 09:24:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:32 user nova-compute[74075]: DEBUG nova.policy [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1e51f861aca4648bd3076ac06369d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90cafbb4d16495b834e4972d0ff2004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Creating image(s)
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-d399f6b4-43ce-4885-8550-56558454545d req-352a1570-bb76-45ee-9257-41c89e0bf8ea service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d399f6b4-43ce-4885-8550-56558454545d req-352a1570-bb76-45ee-9257-41c89e0bf8ea service nova] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d399f6b4-43ce-4885-8550-56558454545d req-352a1570-bb76-45ee-9257-41c89e0bf8ea service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d399f6b4-43ce-4885-8550-56558454545d req-352a1570-bb76-45ee-9257-41c89e0bf8ea service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-d399f6b4-43ce-4885-8550-56558454545d req-352a1570-bb76-45ee-9257-41c89e0bf8ea service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] No waiting events found dispatching network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:33 user nova-compute[74075]: WARNING nova.compute.manager [req-d399f6b4-43ce-4885-8550-56558454545d req-352a1570-bb76-45ee-9257-41c89e0bf8ea service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received unexpected event network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 for instance with vm_state building and task_state spawning.
Oct 26 09:24:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.695s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-e85ceb1b-090f-4c5a-9e31-fae63bff0480 req-b777842a-fee9-43aa-b8b1-9f766d56b053 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e85ceb1b-090f-4c5a-9e31-fae63bff0480 req-b777842a-fee9-43aa-b8b1-9f766d56b053 service nova] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e85ceb1b-090f-4c5a-9e31-fae63bff0480 req-b777842a-fee9-43aa-b8b1-9f766d56b053 service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e85ceb1b-090f-4c5a-9e31-fae63bff0480 req-b777842a-fee9-43aa-b8b1-9f766d56b053 service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-e85ceb1b-090f-4c5a-9e31-fae63bff0480 req-b777842a-fee9-43aa-b8b1-9f766d56b053 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] No waiting events found dispatching network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:33 user nova-compute[74075]: WARNING nova.compute.manager [req-e85ceb1b-090f-4c5a-9e31-fae63bff0480 req-b777842a-fee9-43aa-b8b1-9f766d56b053 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received unexpected event network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 for instance with vm_state building and task_state spawning.
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.223s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk 1073741824" returned: 0 in 0.116s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.240s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Successfully created port: 7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Cannot resize image /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Ensure instance console log exists: /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-5471d782-3f84-48b1-978f-254d1c2259a4 req-5e3bde76-2238-4d13-b49e-2a4ac89c3b2b service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5471d782-3f84-48b1-978f-254d1c2259a4 req-5e3bde76-2238-4d13-b49e-2a4ac89c3b2b service nova] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5471d782-3f84-48b1-978f-254d1c2259a4 req-5e3bde76-2238-4d13-b49e-2a4ac89c3b2b service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5471d782-3f84-48b1-978f-254d1c2259a4 req-5e3bde76-2238-4d13-b49e-2a4ac89c3b2b service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-5471d782-3f84-48b1-978f-254d1c2259a4 req-5e3bde76-2238-4d13-b49e-2a4ac89c3b2b service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] No waiting events found dispatching network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:35 user nova-compute[74075]: WARNING nova.compute.manager [req-5471d782-3f84-48b1-978f-254d1c2259a4 req-5e3bde76-2238-4d13-b49e-2a4ac89c3b2b service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received unexpected event network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 for instance with vm_state building and task_state spawning.
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Successfully updated port: 7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquired lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Releasing lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Instance network_info: |[{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Start _get_guest_xml network_info=[{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:35 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:35 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:35 user nova-compute[74075]:   <uuid>8a38837e-a0c6-43c2-af40-ad1db9d651ce</uuid>
Oct 26 09:24:35 user nova-compute[74075]:   <name>instance-00000008</name>
Oct 26 09:24:35 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:35 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:35 user nova-compute[74075]:   <metadata>
Oct 26 09:24:35 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:35 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:35 user nova-compute[74075]:       <nova:name>tempest-device-tagging-server-1189807003</nova:name>
Oct 26 09:24:35 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:35</nova:creationTime>
Oct 26 09:24:35 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:35 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:35 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:35 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:user uuid="f1e51f861aca4648bd3076ac06369d7a">tempest-TaggedAttachmentsTest-1885075461-project-member</nova:user>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:project uuid="a90cafbb4d16495b834e4972d0ff2004">tempest-TaggedAttachmentsTest-1885075461</nova:project>
Oct 26 09:24:35 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:35 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:35 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:35 user nova-compute[74075]:         <nova:port uuid="7525d4cf-2e19-4d31-8f4c-61c0a6de017e">
Oct 26 09:24:35 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:24:35 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:35 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:35 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:35 user nova-compute[74075]:   </metadata>
Oct 26 09:24:35 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:35 user nova-compute[74075]:     <system>
Oct 26 09:24:35 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:35 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:35 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:35 user nova-compute[74075]:       <entry name="serial">8a38837e-a0c6-43c2-af40-ad1db9d651ce</entry>
Oct 26 09:24:35 user nova-compute[74075]:       <entry name="uuid">8a38837e-a0c6-43c2-af40-ad1db9d651ce</entry>
Oct 26 09:24:35 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:35 user nova-compute[74075]:     </system>
Oct 26 09:24:35 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:35 user nova-compute[74075]:   <os>
Oct 26 09:24:35 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:35 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:35 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:35 user nova-compute[74075]:   </os>
Oct 26 09:24:35 user nova-compute[74075]:   <features>
Oct 26 09:24:35 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:35 user nova-compute[74075]:     <apic/>
Oct 26 09:24:35 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:35 user nova-compute[74075]:   </features>
Oct 26 09:24:35 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:35 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:35 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:35 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:35 user nova-compute[74075]:   </clock>
Oct 26 09:24:35 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:35 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:35 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:35 user nova-compute[74075]:   </cpu>
Oct 26 09:24:35 user nova-compute[74075]:   <devices>
Oct 26 09:24:35 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:35 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:35 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk"/>
Oct 26 09:24:35 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:35 user nova-compute[74075]:     </disk>
Oct 26 09:24:35 user nova-compute[74075]:     <disk type="file" device="cdrom">
Oct 26 09:24:35 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 09:24:35 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.config"/>
Oct 26 09:24:35 user nova-compute[74075]:       <target dev="hda" bus="ide"/>
Oct 26 09:24:35 user nova-compute[74075]:     </disk>
Oct 26 09:24:35 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:35 user nova-compute[74075]:       <mac address="fa:16:3e:a2:4b:20"/>
Oct 26 09:24:35 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:35 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:35 user nova-compute[74075]:       <target dev="tap7525d4cf-2e"/>
Oct 26 09:24:35 user nova-compute[74075]:     </interface>
Oct 26 09:24:35 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:35 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/console.log" append="off"/>
Oct 26 09:24:35 user nova-compute[74075]:     </serial>
Oct 26 09:24:35 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:35 user nova-compute[74075]:     <video>
Oct 26 09:24:35 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:35 user nova-compute[74075]:     </video>
Oct 26 09:24:35 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:35 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:35 user nova-compute[74075]:     </rng>
Oct 26 09:24:35 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:35 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:35 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:35 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:35 user nova-compute[74075]:   </devices>
Oct 26 09:24:35 user nova-compute[74075]: </domain>
Oct 26 09:24:35 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG os_vif [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ab85c23-fe81-514f-b25f-fda135df1ed6', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Instance spawned successfully.
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7525d4cf-2e, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7525d4cf-2e, col_values=(('qos', UUID('d8583b9f-74cf-4770-8021-782814463b32')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7525d4cf-2e, col_values=(('external_ids', {'iface-id': '7525d4cf-2e19-4d31-8f4c-61c0a6de017e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:4b:20', 'vm-uuid': '8a38837e-a0c6-43c2-af40-ad1db9d651ce'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: INFO os_vif [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e')
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Instance spawned successfully.
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No BDM found with device name hda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No VIF found with MAC fa:16:3e:a2:4b:20, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Using config drive
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Took 10.27 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Took 14.83 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-changed-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Refreshing instance network info cache due to event network-changed-7525d4cf-2e19-4d31-8f4c-61c0a6de017e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] Acquiring lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] Acquired lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Refreshing network info cache for port 7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.compute.manager [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Took 12.39 seconds to build instance.
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.compute.manager [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Took 17.28 seconds to build instance.
Oct 26 09:24:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0963887b-f7da-4022-8332-58c37cade048 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.681s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a329758-9106-40c0-b591-f5bc46975b8a tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.473s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Creating config drive at /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.config
Oct 26 09:24:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6vrwo049 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6vrwo049" returned: 0 in 0.121s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updated VIF entry in instance network info cache for port 7525d4cf-2e19-4d31-8f4c-61c0a6de017e. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:24:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e2801e5a-0ea8-4e18-b6b9-1da1a8dfcdce req-55c021d7-7a00-40d2-aa80-01012bd198b8 service nova] Releasing lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-1f36c670-0de7-4b77-8722-2e0223191e3d req-39878498-eca0-4db1-ba53-9170d34d20ab service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1f36c670-0de7-4b77-8722-2e0223191e3d req-39878498-eca0-4db1-ba53-9170d34d20ab service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1f36c670-0de7-4b77-8722-2e0223191e3d req-39878498-eca0-4db1-ba53-9170d34d20ab service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1f36c670-0de7-4b77-8722-2e0223191e3d req-39878498-eca0-4db1-ba53-9170d34d20ab service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-1f36c670-0de7-4b77-8722-2e0223191e3d req-39878498-eca0-4db1-ba53-9170d34d20ab service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:38 user nova-compute[74075]: WARNING nova.compute.manager [req-1f36c670-0de7-4b77-8722-2e0223191e3d req-39878498-eca0-4db1-ba53-9170d34d20ab service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state active and task_state None.
Oct 26 09:24:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-b9411459-8f09-4597-84f3-9ca6a42972dc req-eb9ae52f-3b71-4db9-baa9-7c30fda52426 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b9411459-8f09-4597-84f3-9ca6a42972dc req-eb9ae52f-3b71-4db9-baa9-7c30fda52426 service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b9411459-8f09-4597-84f3-9ca6a42972dc req-eb9ae52f-3b71-4db9-baa9-7c30fda52426 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b9411459-8f09-4597-84f3-9ca6a42972dc req-eb9ae52f-3b71-4db9-baa9-7c30fda52426 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-b9411459-8f09-4597-84f3-9ca6a42972dc req-eb9ae52f-3b71-4db9-baa9-7c30fda52426 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:39 user nova-compute[74075]: WARNING nova.compute.manager [req-b9411459-8f09-4597-84f3-9ca6a42972dc req-eb9ae52f-3b71-4db9-baa9-7c30fda52426 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e for instance with vm_state building and task_state spawning.
Oct 26 09:24:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:40 user nova-compute[74075]: WARNING nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state active and task_state None.
Oct 26 09:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] No waiting events found dispatching network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:40 user nova-compute[74075]: WARNING nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received unexpected event network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 for instance with vm_state active and task_state None.
Oct 26 09:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] No waiting events found dispatching network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:40 user nova-compute[74075]: WARNING nova.compute.manager [req-05fd0113-a451-4b32-af1b-06cbfc446011 req-bfe56d40-f95c-4262-ac2f-110edad0a5e8 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received unexpected event network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 for instance with vm_state active and task_state None.
Oct 26 09:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-6bd350b8-0aae-470e-8e05-9020ad0760eb req-fbd9db15-3388-4174-94d1-797861674b26 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6bd350b8-0aae-470e-8e05-9020ad0760eb req-fbd9db15-3388-4174-94d1-797861674b26 service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6bd350b8-0aae-470e-8e05-9020ad0760eb req-fbd9db15-3388-4174-94d1-797861674b26 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6bd350b8-0aae-470e-8e05-9020ad0760eb req-fbd9db15-3388-4174-94d1-797861674b26 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-6bd350b8-0aae-470e-8e05-9020ad0760eb req-fbd9db15-3388-4174-94d1-797861674b26 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:41 user nova-compute[74075]: WARNING nova.compute.manager [req-6bd350b8-0aae-470e-8e05-9020ad0760eb req-fbd9db15-3388-4174-94d1-797861674b26 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e for instance with vm_state building and task_state spawning.
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Instance spawned successfully.
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:42 user nova-compute[74075]: INFO nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Took 9.37 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:42 user nova-compute[74075]: INFO nova.compute.manager [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Took 10.80 seconds to build instance.
Oct 26 09:24:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c00b1fff-19da-4a39-afba-c40e736f1084 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.050s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:24:43 user nova-compute[74075]: INFO nova.compute.claims [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Claim successful on node user
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Skipping network cache update for instance because it is Building. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:24:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.policy [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '023aaa53dfdc419c93f6da7c6dabb11a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def8c9b1af2b4942887354a61898d4be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:24:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Creating image(s)
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "/opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "/opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.332s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.247s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk 1073741824" returned: 0 in 0.100s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Successfully created port: 581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.255s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Cannot resize image /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Ensure instance console log exists: /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Successfully updated port: 581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-changed-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Refreshing instance network info cache due to event network-changed-581e22e2-18c0-44aa-ad95-dabbe628d748. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] Acquiring lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] Acquired lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Refreshing network info cache for port 581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.network.neutron [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-170b7131-299c-4541-a0b4-b96318b6a361 req-6d579698-e017-4caa-94aa-8ea0f19114e4 service nova] Releasing lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquired lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updating instance_info_cache with network_info: [{"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Releasing lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Instance network_info: |[{"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Start _get_guest_xml network_info=[{"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:24:47 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:47 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-884873962',display_name='tempest-VolumesAssistedSnapshotsTest-server-884873962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-884873962',id=9,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+ntY7foSY2IrDCSfOw3s3tSjYB4kp201JwU48/QH5IlBpesXAiIGiG288uMxjdEWIRpmFQqNrYToet2AO6b8BsGXmwZTE9rRbuncSjeE6LYLn4vpj6x3+hf56V1L688w==',key_name='tempest-keypair-73154081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='def8c9b1af2b4942887354a61898d4be',ramdisk_id='',reservation_id='r-exn606ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1848008629',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1848008629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='023aaa53dfdc419c93f6da7c6dabb11a',uuid=dd951a2e-120b-4ddb-81f9-ed4198e099a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Converting VIF {"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lazy-loading 'pci_devices' on Instance uuid dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:24:48 user nova-compute[74075]:   <uuid>dd951a2e-120b-4ddb-81f9-ed4198e099a5</uuid>
Oct 26 09:24:48 user nova-compute[74075]:   <name>instance-00000009</name>
Oct 26 09:24:48 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:24:48 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:24:48 user nova-compute[74075]:   <metadata>
Oct 26 09:24:48 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:24:48 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:24:48 user nova-compute[74075]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-884873962</nova:name>
Oct 26 09:24:48 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:24:47</nova:creationTime>
Oct 26 09:24:48 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:24:48 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:24:48 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:24:48 user nova-compute[74075]:       <nova:owner>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:user uuid="023aaa53dfdc419c93f6da7c6dabb11a">tempest-VolumesAssistedSnapshotsTest-1848008629-project-member</nova:user>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:project uuid="def8c9b1af2b4942887354a61898d4be">tempest-VolumesAssistedSnapshotsTest-1848008629</nova:project>
Oct 26 09:24:48 user nova-compute[74075]:       </nova:owner>
Oct 26 09:24:48 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:24:48 user nova-compute[74075]:       <nova:ports>
Oct 26 09:24:48 user nova-compute[74075]:         <nova:port uuid="581e22e2-18c0-44aa-ad95-dabbe628d748">
Oct 26 09:24:48 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:24:48 user nova-compute[74075]:         </nova:port>
Oct 26 09:24:48 user nova-compute[74075]:       </nova:ports>
Oct 26 09:24:48 user nova-compute[74075]:     </nova:instance>
Oct 26 09:24:48 user nova-compute[74075]:   </metadata>
Oct 26 09:24:48 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:24:48 user nova-compute[74075]:     <system>
Oct 26 09:24:48 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:24:48 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:24:48 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:24:48 user nova-compute[74075]:       <entry name="serial">dd951a2e-120b-4ddb-81f9-ed4198e099a5</entry>
Oct 26 09:24:48 user nova-compute[74075]:       <entry name="uuid">dd951a2e-120b-4ddb-81f9-ed4198e099a5</entry>
Oct 26 09:24:48 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:24:48 user nova-compute[74075]:     </system>
Oct 26 09:24:48 user nova-compute[74075]:   </sysinfo>
Oct 26 09:24:48 user nova-compute[74075]:   <os>
Oct 26 09:24:48 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:24:48 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:24:48 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:24:48 user nova-compute[74075]:   </os>
Oct 26 09:24:48 user nova-compute[74075]:   <features>
Oct 26 09:24:48 user nova-compute[74075]:     <acpi/>
Oct 26 09:24:48 user nova-compute[74075]:     <apic/>
Oct 26 09:24:48 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:24:48 user nova-compute[74075]:   </features>
Oct 26 09:24:48 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:24:48 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:24:48 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:24:48 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:24:48 user nova-compute[74075]:   </clock>
Oct 26 09:24:48 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:24:48 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:24:48 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:24:48 user nova-compute[74075]:   </cpu>
Oct 26 09:24:48 user nova-compute[74075]:   <devices>
Oct 26 09:24:48 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:24:48 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:24:48 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk"/>
Oct 26 09:24:48 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:24:48 user nova-compute[74075]:     </disk>
Oct 26 09:24:48 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:24:48 user nova-compute[74075]:       <mac address="fa:16:3e:64:8c:05"/>
Oct 26 09:24:48 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:48 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:24:48 user nova-compute[74075]:       <target dev="tap581e22e2-18"/>
Oct 26 09:24:48 user nova-compute[74075]:     </interface>
Oct 26 09:24:48 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:24:48 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/console.log" append="off"/>
Oct 26 09:24:48 user nova-compute[74075]:     </serial>
Oct 26 09:24:48 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:24:48 user nova-compute[74075]:     <video>
Oct 26 09:24:48 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:24:48 user nova-compute[74075]:     </video>
Oct 26 09:24:48 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:24:48 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:24:48 user nova-compute[74075]:     </rng>
Oct 26 09:24:48 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:24:48 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:24:48 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:24:48 user nova-compute[74075]:     </memballoon>
Oct 26 09:24:48 user nova-compute[74075]:   </devices>
Oct 26 09:24:48 user nova-compute[74075]: </domain>
Oct 26 09:24:48 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-884873962',display_name='tempest-VolumesAssistedSnapshotsTest-server-884873962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-884873962',id=9,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+ntY7foSY2IrDCSfOw3s3tSjYB4kp201JwU48/QH5IlBpesXAiIGiG288uMxjdEWIRpmFQqNrYToet2AO6b8BsGXmwZTE9rRbuncSjeE6LYLn4vpj6x3+hf56V1L688w==',key_name='tempest-keypair-73154081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='def8c9b1af2b4942887354a61898d4be',ramdisk_id='',reservation_id='r-exn606ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1848008629',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1848008629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='023aaa53dfdc419c93f6da7c6dabb11a',uuid=dd951a2e-120b-4ddb-81f9-ed4198e099a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Converting VIF {"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG os_vif [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61185c74-378c-5349-9fb0-0143c2aa7591', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap581e22e2-18, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap581e22e2-18, col_values=(('qos', UUID('ebd59594-0773-46e6-ab7e-38c2751e986b')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap581e22e2-18, col_values=(('external_ids', {'iface-id': '581e22e2-18c0-44aa-ad95-dabbe628d748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:8c:05', 'vm-uuid': 'dd951a2e-120b-4ddb-81f9-ed4198e099a5'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:48 user nova-compute[74075]: INFO os_vif [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18')
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] No VIF found with MAC fa:16:3e:64:8c:05, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:24:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.492s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-75907ed7-b77f-4324-8d0b-6e00e7e1a4be req-2d9f5cce-92bd-48ee-a29c-bed1c398f0c1 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-75907ed7-b77f-4324-8d0b-6e00e7e1a4be req-2d9f5cce-92bd-48ee-a29c-bed1c398f0c1 service nova] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-75907ed7-b77f-4324-8d0b-6e00e7e1a4be req-2d9f5cce-92bd-48ee-a29c-bed1c398f0c1 service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-75907ed7-b77f-4324-8d0b-6e00e7e1a4be req-2d9f5cce-92bd-48ee-a29c-bed1c398f0c1 service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-75907ed7-b77f-4324-8d0b-6e00e7e1a4be req-2d9f5cce-92bd-48ee-a29c-bed1c398f0c1 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] No waiting events found dispatching network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:54 user nova-compute[74075]: WARNING nova.compute.manager [req-75907ed7-b77f-4324-8d0b-6e00e7e1a4be req-2d9f5cce-92bd-48ee-a29c-bed1c398f0c1 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received unexpected event network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 for instance with vm_state building and task_state spawning.
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-34cf9e31-51ad-4fdf-9c1c-bcfbfdab763f req-c628a0b2-14ca-40a3-ab5b-325aca73af73 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34cf9e31-51ad-4fdf-9c1c-bcfbfdab763f req-c628a0b2-14ca-40a3-ab5b-325aca73af73 service nova] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34cf9e31-51ad-4fdf-9c1c-bcfbfdab763f req-c628a0b2-14ca-40a3-ab5b-325aca73af73 service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34cf9e31-51ad-4fdf-9c1c-bcfbfdab763f req-c628a0b2-14ca-40a3-ab5b-325aca73af73 service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-34cf9e31-51ad-4fdf-9c1c-bcfbfdab763f req-c628a0b2-14ca-40a3-ab5b-325aca73af73 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] No waiting events found dispatching network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:24:54 user nova-compute[74075]: WARNING nova.compute.manager [req-34cf9e31-51ad-4fdf-9c1c-bcfbfdab763f req-c628a0b2-14ca-40a3-ab5b-325aca73af73 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received unexpected event network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 for instance with vm_state building and task_state spawning.
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:24:54 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Instance spawned successfully.
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:24:54 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:54 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.713397979736328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:24:54 user nova-compute[74075]: INFO nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Took 9.88 seconds to spawn the instance on the hypervisor.
Oct 26 09:24:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:24:54 user nova-compute[74075]: INFO nova.compute.manager [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Took 11.15 seconds to build instance.
Oct 26 09:24:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c69e7b3-00de-46c6-8832-b981d6ec9a7e tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.315s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8fde35bc-f050-40fa-8975-b10691739658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.209s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:24:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:24:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:24:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "01e34352-139a-446b-a738-f60aae9c02a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:25:33 user nova-compute[74075]: INFO nova.compute.claims [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Claim successful on node user
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:25:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:25:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:25:33 user nova-compute[74075]: INFO nova.virt.block_device [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Booting with volume e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 at /dev/vda
Oct 26 09:25:34 user nova-compute[74075]: DEBUG nova.policy [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c72261377aed422dab1948357f7a035e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfd8436061f42e88cc89505087c2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:25:34 user nova-compute[74075]: DEBUG os_brick.utils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:25:34 user nova-compute[74075]: INFO oslo.privsep.daemon [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7ttmud7h/privsep.sock']
Oct 26 09:25:34 user sudo[85471]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7ttmud7h/privsep.sock
Oct 26 09:25:34 user sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 09:25:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully created port: 1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:25:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully created port: bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:25:36 user sudo[85471]: pam_unix(sudo:session): session closed for user root
Oct 26 09:25:36 user nova-compute[74075]: INFO oslo.privsep.daemon [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Spawned new privsep daemon via rootwrap
Oct 26 09:25:36 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 09:25:36 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 09:25:36 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 26 09:25:36 user nova-compute[74075]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85490
Oct 26 09:25:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully created port: 5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabbd40b-f34a-4acd-ad59-39021468f2ce]: (2,) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[24627905-6cad-484a-930e-fa671bad3485]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:36 user nova-compute[74075]: WARNING os_brick.initiator.connectors.nvmeof [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd65cabc-5745-45ce-8a44-d4e7b5aa18b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba5dd9-9da4-4e47-bdda-1f48650fe75a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e3cf13-f5c5-4908-9382-7822a528711a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:25:36 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:25:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6955fcf8-0130-4f6a-b377-01b2def14df4]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG os_brick.utils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== get_connector_properties: return (2238ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating existing volume attachment record: 7a2b32ca-bc35-45ad-911e-e3d2f3399ae3 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:25:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully created port: eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully created port: 38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: 1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-1096d4b9-0994-4833-9994-7fa46d69e7e1. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port 1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:38 user nova-compute[74075]: DEBUG nova.network.neutron [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:38 user nova-compute[74075]: DEBUG nova.network.neutron [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c8f61adf-5558-4cb4-a3b1-9b1123709371 req-58383203-3c9d-48f5-a007-3da20a50ba14 service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: 9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: 66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-9b67671f-15b1-474f-b542-645d686a9f3a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:39 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port 9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-66c963d1-23e3-461b-a474-d735dc246f4f. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port 66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: 5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b62f3a10-4759-48bb-bd48-33ce3d08fd58 req-9a8cc29e-e0e2-464e-98ad-b2b4cfde0bbd service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-eacd9076-eae3-492a-8b1a-ee98fe10bc17. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-558fe4a2-4c3e-4e72-b812-8da76dfd1e51 req-958b1736-5e01-4e82-bf51-85d18807845a service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-5c47a0fa-616d-4b3c-99f5-421ac07d4259. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port 5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Successfully updated port: 38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d8e3bdd3-e8f2-46cc-9d50-ba361df0193c req-e8904cf5-ac79-404e-aa8b-f1fcb471e43f service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:25:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:25:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-38db9e7d-1a60-453c-a7fc-90b00e6ae62f. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance network_info: |[{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port 38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updated VIF entry in instance network info cache for port 38db9e7d-1a60-453c-a7fc-90b00e6ae62f. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-94473e14-67e5-46f3-86a2-81579045fc48 req-81cc630c-8a8a-4b87-9c1a-4071ced308ef service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:25:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7208MB free_disk=25.59947967529297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8fde35bc-f050-40fa-8975-b10691739658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 01e34352-139a-446b-a738-f60aae9c02a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:25:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:25:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:25:52 user nova-compute[74075]: INFO nova.compute.manager [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Rescuing
Oct 26 09:25:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:25:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-48323e29-c2ac-4e00-977e-6d323bb77e5e req-0442083e-325a-4f10-be8d-d2e1a3b208c5 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-unplugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-48323e29-c2ac-4e00-977e-6d323bb77e5e req-0442083e-325a-4f10-be8d-d2e1a3b208c5 service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-48323e29-c2ac-4e00-977e-6d323bb77e5e req-0442083e-325a-4f10-be8d-d2e1a3b208c5 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-48323e29-c2ac-4e00-977e-6d323bb77e5e req-0442083e-325a-4f10-be8d-d2e1a3b208c5 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-48323e29-c2ac-4e00-977e-6d323bb77e5e req-0442083e-325a-4f10-be8d-d2e1a3b208c5 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-unplugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:25:53 user nova-compute[74075]: WARNING nova.compute.manager [req-48323e29-c2ac-4e00-977e-6d323bb77e5e req-0442083e-325a-4f10-be8d-d2e1a3b208c5 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-unplugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state active and task_state rescuing.
Oct 26 09:25:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance destroyed successfully.
Oct 26 09:25:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Attempting rescue
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74075) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:25:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Creating image(s)
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue" returned: 0 in 0.060s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'migration_context' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.base [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<839ef064-055b-4050-9c92-8913891abfe3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Start _get_guest_xml network_info=[{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:b9:b5:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'resources' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.base [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<839ef064-055b-4050-9c92-8913891abfe3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'numa_topology' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.objects.base [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<839ef064-055b-4050-9c92-8913891abfe3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:25:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:25:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:25:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.objects.base [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<839ef064-055b-4050-9c92-8913891abfe3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1379992131',display_name='tempest-ServerRescueNegativeTestJSON-server-1379992131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1379992131',id=2,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-2bwn082t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:20Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=839ef064-055b-4050-9c92-8913891abfe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:b9:b5:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:b9:b5:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'pci_devices' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.objects.base [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<839ef064-055b-4050-9c92-8913891abfe3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:25:54 user nova-compute[74075]:   <uuid>839ef064-055b-4050-9c92-8913891abfe3</uuid>
Oct 26 09:25:54 user nova-compute[74075]:   <name>instance-00000002</name>
Oct 26 09:25:54 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:25:54 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:25:54 user nova-compute[74075]:   <metadata>
Oct 26 09:25:54 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:25:54 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:25:54 user nova-compute[74075]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1379992131</nova:name>
Oct 26 09:25:54 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:25:53</nova:creationTime>
Oct 26 09:25:54 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:25:54 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:25:54 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:25:54 user nova-compute[74075]:       <nova:owner>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:user uuid="82d86b9184a1410db33192820885da0f">tempest-ServerRescueNegativeTestJSON-336149992-project-member</nova:user>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:project uuid="e453d88800e642b98d9b66dde5fe2e73">tempest-ServerRescueNegativeTestJSON-336149992</nova:project>
Oct 26 09:25:54 user nova-compute[74075]:       </nova:owner>
Oct 26 09:25:54 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:25:54 user nova-compute[74075]:       <nova:ports>
Oct 26 09:25:54 user nova-compute[74075]:         <nova:port uuid="bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9">
Oct 26 09:25:54 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 09:25:54 user nova-compute[74075]:         </nova:port>
Oct 26 09:25:54 user nova-compute[74075]:       </nova:ports>
Oct 26 09:25:54 user nova-compute[74075]:     </nova:instance>
Oct 26 09:25:54 user nova-compute[74075]:   </metadata>
Oct 26 09:25:54 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:25:54 user nova-compute[74075]:     <system>
Oct 26 09:25:54 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:25:54 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:25:54 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:25:54 user nova-compute[74075]:       <entry name="serial">839ef064-055b-4050-9c92-8913891abfe3</entry>
Oct 26 09:25:54 user nova-compute[74075]:       <entry name="uuid">839ef064-055b-4050-9c92-8913891abfe3</entry>
Oct 26 09:25:54 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:25:54 user nova-compute[74075]:     </system>
Oct 26 09:25:54 user nova-compute[74075]:   </sysinfo>
Oct 26 09:25:54 user nova-compute[74075]:   <os>
Oct 26 09:25:54 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:25:54 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:25:54 user nova-compute[74075]:   </os>
Oct 26 09:25:54 user nova-compute[74075]:   <features>
Oct 26 09:25:54 user nova-compute[74075]:     <acpi/>
Oct 26 09:25:54 user nova-compute[74075]:     <apic/>
Oct 26 09:25:54 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:25:54 user nova-compute[74075]:   </features>
Oct 26 09:25:54 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:25:54 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:25:54 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:25:54 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:25:54 user nova-compute[74075]:   </clock>
Oct 26 09:25:54 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:25:54 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:25:54 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:25:54 user nova-compute[74075]:   </cpu>
Oct 26 09:25:54 user nova-compute[74075]:   <devices>
Oct 26 09:25:54 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:25:54 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:25:54 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue"/>
Oct 26 09:25:54 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:25:54 user nova-compute[74075]:     </disk>
Oct 26 09:25:54 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:25:54 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:25:54 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk"/>
Oct 26 09:25:54 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:25:54 user nova-compute[74075]:     </disk>
Oct 26 09:25:54 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:25:54 user nova-compute[74075]:       <mac address="fa:16:3e:b9:b5:9b"/>
Oct 26 09:25:54 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:25:54 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:25:54 user nova-compute[74075]:       <target dev="tapbacc94ad-3b"/>
Oct 26 09:25:54 user nova-compute[74075]:     </interface>
Oct 26 09:25:54 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:25:54 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/console.log" append="off"/>
Oct 26 09:25:54 user nova-compute[74075]:     </serial>
Oct 26 09:25:54 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:25:54 user nova-compute[74075]:     <video>
Oct 26 09:25:54 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:25:54 user nova-compute[74075]:     </video>
Oct 26 09:25:54 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:25:54 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:25:54 user nova-compute[74075]:     </rng>
Oct 26 09:25:54 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:25:54 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:25:54 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:25:54 user nova-compute[74075]:     </memballoon>
Oct 26 09:25:54 user nova-compute[74075]:   </devices>
Oct 26 09:25:54 user nova-compute[74075]: </domain>
Oct 26 09:25:54 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:25:54 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance destroyed successfully.
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-changed-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Refreshing instance network info cache due to event network-changed-48f496fc-e8b1-4065-b6a7-9c2e7512be56. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] Acquiring lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] Acquired lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Refreshing network info cache for port 48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:b9:b5:9b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updated VIF entry in instance network info cache for port 48f496fc-e8b1-4065-b6a7-9c2e7512be56. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating instance_info_cache with network_info: [{"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43510fe7-df15-4fdb-bb41-97566ab53772 req-a53b3f8f-d40d-468b-9807-5f6eb4d863e9 service nova] Releasing lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:25:55 user nova-compute[74075]: WARNING nova.compute.manager [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state active and task_state rescuing.
Oct 26 09:25:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-changed-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Refreshing instance network info cache due to event network-changed-bbf845ec-94f6-4489-a12d-2bc5cca19e8a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Refreshing network info cache for port bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:55 user nova-compute[74075]: INFO nova.compute.manager [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] instance snapshotting
Oct 26 09:25:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Beginning live snapshot process
Oct 26 09:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json -f qcow2" returned: 0 in 0.241s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG nova.network.neutron [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updated VIF entry in instance network info cache for port bbf845ec-94f6-4489-a12d-2bc5cca19e8a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG nova.network.neutron [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb64441d-0e9d-4f55-8a1b-b322f8426cbb req-9d17bb03-3287-4508-9a13-02fde07339a9 service nova] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json -f qcow2" returned: 0 in 0.253s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppexvkywt/5a027e17f7454eddaf1242d5b6dec593.delta 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:57 user nova-compute[74075]: INFO nova.virt.block_device [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Booting with volume 243d8798-0c8d-481a-8a9d-20bb69657224 at /dev/vdb
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppexvkywt/5a027e17f7454eddaf1242d5b6dec593.delta 1073741824" returned: 0 in 0.128s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74075) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 26 09:25:57 user nova-compute[74075]: INFO nova.virt.libvirt.host [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] UEFI support detected
Oct 26 09:25:57 user nova-compute[74075]: DEBUG os_brick.utils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cce8a0-16fc-47b1-9e10-dab57fdef2c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6411c-fd6b-48bb-96db-6e711b77a24d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2feb9-4dc1-4ccf-b630-cc104db6ddca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[af29c7ec-d7c8-4b89-b74e-f86077fac07d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:25:57 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03b6f6-3100-4ed4-ba58-5a6e38aea4fc]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG os_brick.utils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating existing volume attachment record: c00391c3-3b9e-42c3-bfb2-3730ab5221c6 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:25:57 user nova-compute[74075]: WARNING nova.compute.manager [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state active and task_state rescuing.
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:25:57 user nova-compute[74075]: WARNING nova.compute.manager [req-fe007ca3-2cb0-488c-ab96-ed62a1272595 req-736c4c74-471d-444a-95f9-bd8eaca6abc8 service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state active and task_state rescuing.
Oct 26 09:25:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:25:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] COPY block job progress, current cursor: 24903680 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:25:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5def6734-5737-4f1d-a0c6-187f64686ed1 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:25:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:25:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 09:25:59 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:25:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppexvkywt/5a027e17f7454eddaf1242d5b6dec593.delta /opt/stack/data/nova/instances/snapshots/tmppexvkywt/5a027e17f7454eddaf1242d5b6dec593 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:25:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppexvkywt/5a027e17f7454eddaf1242d5b6dec593.delta /opt/stack/data/nova/instances/snapshots/tmppexvkywt/5a027e17f7454eddaf1242d5b6dec593" returned: 0 in 0.493s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:25:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Snapshot extracted, beginning image upload
Oct 26 09:25:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-changed-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Refreshing instance network info cache due to event network-changed-c82c639c-ebc3-4b59-926b-f5e1ae424576. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] Acquiring lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] Acquired lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG nova.network.neutron [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Refreshing network info cache for port c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:02 user nova-compute[74075]: INFO nova.compute.manager [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Attaching volume 8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d to /dev/vdb
Oct 26 09:26:02 user nova-compute[74075]: DEBUG os_brick.utils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2bffa0-9057-4b4f-af06-6922cbd22e1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d0d1e-ad65-4cc8-8171-37f41de56f3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe8e9b-c13d-4c05-afe4-8a667fc53cde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f3b68-6075-4893-a492-98bc9e953d4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:02 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aa47fd-7924-47b9-8863-3576aa0599a4]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG os_brick.utils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:02 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating existing volume attachment record: adf45f8e-3913-4663-8f15-e4d1179c00f6 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Snapshot image upload complete
Oct 26 09:26:02 user nova-compute[74075]: INFO nova.compute.manager [None req-1682b6ed-14d8-43f6-91cd-ce1f297ab2fd tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Took 7.19 seconds to snapshot the instance on the hypervisor.
Oct 26 09:26:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updated VIF entry in instance network info cache for port c82c639c-ebc3-4b59-926b-f5e1ae424576. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:26:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating instance_info_cache with network_info: [{"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d8e9401b-a5a4-442d-b901-8656c9da497c req-9532b16d-d6bc-4c36-baf1-c66f7c256fbe service nova] Releasing lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'flavor' on Instance uuid 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:09 user nova-compute[74075]: INFO nova.compute.manager [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Attaching volume 76863e16-7e2c-4458-a4cf-6ced7c373b44 to /dev/vdb
Oct 26 09:26:09 user nova-compute[74075]: DEBUG os_brick.utils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb72accf-e4d2-4acc-b7dc-3123dcedb285]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2859a565-a78c-4900-b151-6dfb148eb971]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de406e-556b-477f-9760-319d638c9966]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[40457c0b-0f85-42d2-9d76-bd560503fab0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:09 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabeb519-26cf-4ea0-a380-4c4b2380e9d8]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG os_brick.utils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating existing volume attachment record: 37d84ce8-0f7e-4a55-a1ab-192134454a83 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-changed-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Refreshing instance network info cache due to event network-changed-410accba-c082-4e57-98ac-02e80c2d76a0. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] Acquiring lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] Acquired lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Refreshing network info cache for port 410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:26:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updated VIF entry in instance network info cache for port 410accba-c082-4e57-98ac-02e80c2d76a0. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:26:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updating instance_info_cache with network_info: [{"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-39c4340a-531a-4251-89ab-0b6a1e8c5f8a req-9a131b19-593d-46c1-958a-6edba4384a76 service nova] Releasing lock "refresh_cache-8fde35bc-f050-40fa-8975-b10691739658" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-changed-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Refreshing instance network info cache due to event network-changed-13bbf9da-ac50-405f-a1bb-346c1a79b1c3. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] Acquiring lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] Acquired lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG nova.network.neutron [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Refreshing network info cache for port 13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG nova.network.neutron [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updated VIF entry in instance network info cache for port 13bbf9da-ac50-405f-a1bb-346c1a79b1c3. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG nova.network.neutron [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updating instance_info_cache with network_info: [{"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-30c93605-fdf8-4787-9c45-dd2ced6efb86 req-7b7847e7-8c6f-4bfb-84ac-f01031b3cef3 service nova] Releasing lock "refresh_cache-771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:18 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lazy-loading 'flavor' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:19 user nova-compute[74075]: INFO nova.virt.block_device [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Booting with volume abf27916-77c3-49ba-87a3-45eeb7d5d2b0 at /dev/vdc
Oct 26 09:26:19 user nova-compute[74075]: DEBUG os_brick.utils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[04abdf1c-1ff4-4a54-bdd1-91f69a9c5ee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7f67fd-50b5-43e7-99c4-900a24adf24e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d049060-4ac7-4c67-8e3d-81da793ededa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfdd21-4c99-4243-9b97-a1035970649b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:19 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc176ef-ad0f-4f40-8a52-63865d9a707b]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG os_brick.utils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating existing volume attachment record: 5795fe04-fc1c-4de5-949d-daf5b043a008 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:19 user nova-compute[74075]: INFO nova.compute.manager [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Attaching volume 2901dbbf-756a-482c-99f0-a70ea04cffcd to /dev/vdb
Oct 26 09:26:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-changed-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Refreshing instance network info cache due to event network-changed-7525d4cf-2e19-4d31-8f4c-61c0a6de017e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] Acquiring lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] Acquired lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.network.neutron [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Refreshing network info cache for port 7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.network.neutron [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updated VIF entry in instance network info cache for port 7525d4cf-2e19-4d31-8f4c-61c0a6de017e. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.network.neutron [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ea95154c-7507-4f1c-8250-46bf6a48cf98 req-2d5620c9-fedd-429f-84cf-f44e7e7d7e60 service nova] Releasing lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "interface-8a38837e-a0c6-43c2-af40-ad1db9d651ce-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "interface-8a38837e-a0c6-43c2-af40-ad1db9d651ce-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'flavor' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.objects.base [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Object Instance<8a38837e-a0c6-43c2-af40-ad1db9d651ce> lazy-loaded attributes: flavor,pci_requests {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:26:22 user nova-compute[74075]: DEBUG nova.policy [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1e51f861aca4648bd3076ac06369d7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90cafbb4d16495b834e4972d0ff2004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:26:23 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Successfully created port: 9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Successfully updated port: 9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquired lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-changed-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Refreshing instance network info cache due to event network-changed-9c70564e-8e15-4072-92f9-72bd83d016e1. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] Acquiring lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Releasing lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] Acquired lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Refreshing network info cache for port 9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG os_vif [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4994e7f-fda1-5059-95bb-8240aa3aa5d6', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c70564e-8e, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c70564e-8e, col_values=(('qos', UUID('55c2ab36-a738-42f4-a33d-25e894287901')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c70564e-8e, col_values=(('external_ids', {'iface-id': '9c70564e-8e15-4072-92f9-72bd83d016e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:65:17', 'vm-uuid': '8a38837e-a0c6-43c2-af40-ad1db9d651ce'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: INFO os_vif [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e')
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] attach device xml: <interface type="ethernet">
Oct 26 09:26:24 user nova-compute[74075]:   <mac address="fa:16:3e:16:65:17"/>
Oct 26 09:26:24 user nova-compute[74075]:   <model type="virtio"/>
Oct 26 09:26:24 user nova-compute[74075]:   <mtu size="1442"/>
Oct 26 09:26:24 user nova-compute[74075]:   <target dev="tap9c70564e-8e"/>
Oct 26 09:26:24 user nova-compute[74075]: </interface>
Oct 26 09:26:24 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No BDM found with device name hda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No VIF found with MAC fa:16:3e:a2:4b:20, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:26:25 user nova-compute[74075]:   <nova:package version="0.0.0"/>
Oct 26 09:26:25 user nova-compute[74075]:   <nova:name>tempest-device-tagging-server-1189807003</nova:name>
Oct 26 09:26:25 user nova-compute[74075]:   <nova:creationTime>2023-10-26 09:26:25</nova:creationTime>
Oct 26 09:26:25 user nova-compute[74075]:   <nova:flavor name="m1.tiny">
Oct 26 09:26:25 user nova-compute[74075]:     <nova:memory>512</nova:memory>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:disk>1</nova:disk>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:swap>0</nova:swap>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:vcpus>1</nova:vcpus>
Oct 26 09:26:25 user nova-compute[74075]:   </nova:flavor>
Oct 26 09:26:25 user nova-compute[74075]:   <nova:owner>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:user uuid="f1e51f861aca4648bd3076ac06369d7a">tempest-TaggedAttachmentsTest-1885075461-project-member</nova:user>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:project uuid="a90cafbb4d16495b834e4972d0ff2004">tempest-TaggedAttachmentsTest-1885075461</nova:project>
Oct 26 09:26:25 user nova-compute[74075]:   </nova:owner>
Oct 26 09:26:25 user nova-compute[74075]:   <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:26:25 user nova-compute[74075]:   <nova:ports>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:port uuid="7525d4cf-2e19-4d31-8f4c-61c0a6de017e">
Oct 26 09:26:25 user nova-compute[74075]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:26:25 user nova-compute[74075]:     </nova:port>
Oct 26 09:26:25 user nova-compute[74075]:     <nova:port uuid="9c70564e-8e15-4072-92f9-72bd83d016e1">
Oct 26 09:26:25 user nova-compute[74075]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 26 09:26:25 user nova-compute[74075]:     </nova:port>
Oct 26 09:26:25 user nova-compute[74075]:   </nova:ports>
Oct 26 09:26:25 user nova-compute[74075]: </nova:instance>
Oct 26 09:26:25 user nova-compute[74075]:  {{(pid=74075) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updated VIF entry in instance network info cache for port 9c70564e-8e15-4072-92f9-72bd83d016e1. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-804ecff4-6bec-4399-9e19-f0236673dc36 req-611fbf57-27cf-4a37-b628-a772db999799 service nova] Releasing lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c0814ca1-a822-44d6-aaab-7b7ca8a5b09e tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "interface-8a38837e-a0c6-43c2-af40-ad1db9d651ce-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.334s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:26:26 user nova-compute[74075]: WARNING nova.compute.manager [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 for instance with vm_state active and task_state None.
Oct 26 09:26:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:26:26 user nova-compute[74075]: WARNING nova.compute.manager [req-d9709556-4343-4b9b-932e-d3ba863469b6 req-57334292-36e0-4cd2-bf85-545e95b03c16 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 for instance with vm_state active and task_state None.
Oct 26 09:26:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connector [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Factory for ISCSI on None {{(pid=74075) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:28 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:28 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:28 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc92f2a-ed2b-41a7-b4cb-90373354eebc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:26:28 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e470d8c-a2d1-433d-884d-41115c1265d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d] added
Oct 26 09:26:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2c158-5991-47a7-9284-0cfabd3fc829]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da6238-4bfa-43ef-a905-9118f6c06acc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHDQZzob {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHDQZzob" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a93ce-19ea-419a-81a1-4118951bf308]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KHDQZzob'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd33e2e5-d2b0-4776-bd7d-06f47c2894b0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f6acf1-8853-49b4-9ed8-1309a089e8e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:26:28 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:26:28 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:28 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 09:26:28 user nova-compute[74075]: 
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52aec4-4523-4a95-a8ff-7a3df4a8f215]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]
Oct 26 09:26:28 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.
Oct 26 09:26:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[001530c6-f092-4396-a10c-f94a6d850af9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c163b15-3248-494f-b88d-5b474cb4f4c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.227s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3e0dae-eae1-4d6c-8af1-cdf273759085]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.utils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'flavor' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089dfcd-14f6-412c-989a-1be39e3419a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7db475-bd77-4b07-bba9-221410a29323]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[607409c4-1db6-4014-9e46-e9c95338f2f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b491468-2ad3-4581-99ed-c2212419078d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:29 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66143ce-d5b3-45b4-a6f6-3cfe1e1efc30]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.utils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updating existing volume attachment record: 32138a97-b059-435a-b34c-12c8cb8bea80 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23232366134633162', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232366134633162', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:26:29 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:26:29 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:26:29 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:26:29 user nova-compute[74075]:   <serial>8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d</serial>
Oct 26 09:26:29 user nova-compute[74075]: </disk>
Oct 26 09:26:29 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:26:29 user nova-compute[74075]: DEBUG nova.objects.instance [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lazy-loading 'flavor' on Instance uuid 8fde35bc-f050-40fa-8975-b10691739658 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No VIF found with MAC fa:16:3e:b5:b5:5b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:26:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-changed-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Refreshing instance network info cache due to event network-changed-581e22e2-18c0-44aa-ad95-dabbe628d748. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] Acquiring lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] Acquired lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Refreshing network info cache for port 581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updated VIF entry in instance network info cache for port 581e22e2-18c0-44aa-ad95-dabbe628d748. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updating instance_info_cache with network_info: [{"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-485c340b-a05e-4ca3-9bc0-6686288c3a36 req-55c32201-02d5-4e34-87be-2b37551c9280 service nova] Releasing lock "refresh_cache-dd951a2e-120b-4ddb-81f9-ed4198e099a5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNuFOlVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:48 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:48 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:48 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda549b-bf71-4477-8983-c04cbeef5195]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:26:48 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf24bd8-fc4d-4616-9a59-ca570b181b72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44] added
Oct 26 09:26:48 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5c0fae-5481-49b8-bff0-85da34d7f31d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb56dc01-6698-4289-ae10-eebb1edca782]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNuFOlVH {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNuFOlVH" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8182e184-35d1-40c4-aa82-006f17a18e48]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNuFOlVH'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3fb295-aba9-4403-8a7f-8ff06b1a43e6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6ce43a-f987-4ac2-b5cd-90e1449a5e34]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:48 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:48 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a5b33dd5-6b27-4b0d-a776-b68369884533 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.738s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.objects.instance [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lazy-loading 'flavor' on Instance uuid dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b337fc-c3cc-43eb-bd07-056a1231e8d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260]
Oct 26 09:26:48 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260] successful.
Oct 26 09:26:48 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed33e08-a8f7-4ce3-a929-f8b0fdbb55f6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:48 user nova-compute[74075]: INFO nova.compute.manager [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Attaching volume c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 to /dev/vdb
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa990b6-6ffd-45b7-9b41-d622fe4f1c27]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:48 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:48 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:48 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:48 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ec4777-dd5d-4cbf-82b9-0ee15754ced6]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNuFOlVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:48 user nova-compute[74075]: INFO nova.compute.manager [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Attaching volume f083ca07-6ca3-4318-b752-244569d28226 to /dev/sdc
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:26:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Creating image(s)
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Ensure instance console log exists: /opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Start _get_guest_xml network_info=[{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '7a2b32ca-bc35-45ad-911e-e3d2f3399ae3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZtymkhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01e34352-139a-446b-a738-f60aae9c02a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9', 'serial': 'e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': 'c00391c3-3b9e-42c3-bfb2-3730ab5221c6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwMZCsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01e34352-139a-446b-a738-f60aae9c02a7', 'attached_at': '', 'detached_at': '', 'volume_id': '243d8798-0c8d-481a-8a9d-20bb69657224', 'serial': '243d8798-0c8d-481a-8a9d-20bb69657224'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': '5795fe04-fc1c-4de5-949d-daf5b043a008', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUMhJzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01e34352-139a-446b-a738-f60aae9c02a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'abf27916-77c3-49ba-87a3-45eeb7d5d2b0', 'serial': 'abf27916-77c3-49ba-87a3-45eeb7d5d2b0'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:26:48 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:26:48 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZtymkhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:48 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG os_brick.utils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6203a8fb-3f71-4c40-b304-f39a9db1e275]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e836f-c4c9-4d3c-96cc-102bc73973cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bada9f-05e5-4b08-8f23-caf013bffc9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8dcebc-dc20-4290-adda-23fbc0357e35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:49 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff0fcb3-4b96-4b22-b6ac-f3293a17890b]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.utils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26333633535373465', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333633535373465', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405a154-2804-48cc-b6d3-c70f6d98d5d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.utils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] <== get_connector_properties: return (619ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating existing volume attachment record: 0e5d151e-748f-41eb-bbba-925ae37e94ea {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.822s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:49 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:49 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:49 user nova-compute[74075]: INFO nova.compute.manager [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Attaching volume b92989b3-b93e-4aa9-bf09-345ae037cbbe to /dev/vdb
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc79af-0b57-4cf8-99f0-c0f866897c5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f51e5-3640-47ac-b0ee-047349650356]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:26:49 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:49 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65244af-c56f-4224-ae3c-3414a6de69b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:26:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7348MB free_disk=25.54555892944336GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4487a89-cec5-4554-a92b-8eaaa2bbb1bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e188dbf-e6be-4779-80ef-4711cbcec314]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9] added
Oct 26 09:26:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[deffbc96-3eb9-47f7-8598-418d809f613e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.utils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.objects.instance [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'flavor' on Instance uuid 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74075) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:49 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f70e55-d9c2-40cb-9594-c2b83c469361]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2996522-535c-4a06-bf2d-05edc38cec96]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb6529-dae6-4e08-ac97-733c23042e3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.utils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] <== get_connector_properties: return (298ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updating existing volume attachment record: 0b67e1aa-b339-4497-88e3-1d11f5eab4f1 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZtymkhT {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:26:49 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:26:49 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:26:49 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:26:49 user nova-compute[74075]:   <serial>76863e16-7e2c-4458-a4cf-6ced7c373b44</serial>
Oct 26 09:26:49 user nova-compute[74075]: </disk>
Oct 26 09:26:49 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db355bb-f43f-4f8e-a38e-4cce3266a346]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZtymkhT" returned: 0 in 0.041s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0fa39a-30e2-4caf-95f8-196d0c173d48]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cZtymkhT'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71db1f-4bec-4cda-ba4e-39200ff1a0bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153f5bf-b7ee-4bf5-b179-8e64164d4ca9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe1051-dec2-4aec-9e32-ca8217238abc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:26:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:26:50 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[01381bfe-e0a0-4087-8c36-c1e765969b7f]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.utils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] <== get_connector_properties: return (227ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updating existing volume attachment record: f8eb6e2c-5bef-4350-9029-863f14cb78c0 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2c3628-acce-4ef8-9a06-f015f8ae27bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:50 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:50 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8fde35bc-f050-40fa-8975-b10691739658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 01e34352-139a-446b-a738-f60aae9c02a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8ccfd5-84b5-46d6-81e5-fded951b7b32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260]
Oct 26 09:26:50 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260] successful.
Oct 26 09:26:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c027c6f-e774-4dc2-a6dd-dd0cedf837d1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e65480-d7b9-4e5c-b07a-c914fe99758a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:50 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:50 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:50 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:50 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.652s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fb2051-02ae-4a9a-821f-76f01b8c37ed]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZtymkhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-11890a8e-60ee-4dcb-8819-60b00a518785 req-8855fca8-2ea2-40cc-a35c-4dc6f83c1e45 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-11890a8e-60ee-4dcb-8819-60b00a518785 req-8855fca8-2ea2-40cc-a35c-4dc6f83c1e45 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-11890a8e-60ee-4dcb-8819-60b00a518785 req-8855fca8-2ea2-40cc-a35c-4dc6f83c1e45 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-11890a8e-60ee-4dcb-8819-60b00a518785 req-8855fca8-2ea2-40cc-a35c-4dc6f83c1e45 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-11890a8e-60ee-4dcb-8819-60b00a518785 req-8855fca8-2ea2-40cc-a35c-4dc6f83c1e45 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:26:50 user nova-compute[74075]: WARNING nova.compute.manager [req-11890a8e-60ee-4dcb-8819-60b00a518785 req-8855fca8-2ea2-40cc-a35c-4dc6f83c1e45 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state active and task_state powering-off.
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No VIF found with MAC fa:16:3e:b3:a0:77, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.042s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:50 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance destroyed successfully.
Oct 26 09:26:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:26:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b1d49970-d8d1-434d-8abf-77758a2ad791 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.270s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.712s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== connect_volume: return (2534ms) {'type': 'block', 'scsi_wwn': '23834656662653834', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834656662653834', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.628s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:51 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a2316-4eb2-4bf2-8002-c4c56d466c9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:26:51 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwMZCsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf2e4c-d7e9-4c0f-952e-f309f5179a55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd] added
Oct 26 09:26:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958cddc-d53d-4951-b1fb-b87452200410]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9a2678-66f8-4fb3-8638-c9b763564909]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfYGwAqc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfYGwAqc" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e078b-0dce-4cfa-87fb-91cd7951cd61]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfYGwAqc'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2063842-041d-4750-ac11-052fedfd2fe9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41f3999-90b6-46ca-8c83-4cf1eb1ca790]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c746253f-8af6-4cd0-b349-71a81b8927ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]
Oct 26 09:26:51 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.
Oct 26 09:26:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e95b3e-0027-4583-9eb2-685c2599a5e5]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3b3335-5b1b-44b8-8aed-707833a13dc3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:51 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[409961a4-72a4-4058-a619-be56322a05e7]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:26:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-df939efd-bf5c-4fad-9b58-c353c6939666 req-1d9a8110-4bd5-4a3c-a20d-41557a0d8ccb service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-df939efd-bf5c-4fad-9b58-c353c6939666 req-1d9a8110-4bd5-4a3c-a20d-41557a0d8ccb service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-df939efd-bf5c-4fad-9b58-c353c6939666 req-1d9a8110-4bd5-4a3c-a20d-41557a0d8ccb service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-df939efd-bf5c-4fad-9b58-c353c6939666 req-1d9a8110-4bd5-4a3c-a20d-41557a0d8ccb service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-df939efd-bf5c-4fad-9b58-c353c6939666 req-1d9a8110-4bd5-4a3c-a20d-41557a0d8ccb service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:26:52 user nova-compute[74075]: WARNING nova.compute.manager [req-df939efd-bf5c-4fad-9b58-c353c6939666 req-1d9a8110-4bd5-4a3c-a20d-41557a0d8ccb service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state stopped and task_state None.
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating instance_info_cache with network_info: [{"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-5b47826e-624e-4045-b5bc-2b764caf3d25" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] <== connect_volume: return (2958ms) {'type': 'block', 'scsi_wwn': '26461333333376336', 'path': '/dev/sde'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461333333376336', 'path': '/dev/sde'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.299s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:52 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:52 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lazy-loading 'flavor' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[401ba568-e20a-4afa-952e-4da901c86bdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:26:52 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:26:52 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:26:52 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:26:52 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:26:52 user nova-compute[74075]:   <serial>2901dbbf-756a-482c-99f0-a70ea04cffcd</serial>
Oct 26 09:26:52 user nova-compute[74075]: </disk>
Oct 26 09:26:52 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39c469-20e3-45be-b2e9-8645d7c90646]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224] added
Oct 26 09:26:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc797b3-26aa-4119-b002-bf1a2ad1b51f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8176209-4346-4eed-8992-a5b4b695cd7e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdwMZCsB {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdwMZCsB" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9a5959-40cb-4d7e-9279-11b0e5bd53bf]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdwMZCsB'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19508b1-f35e-44da-8655-1f5af47c0248]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c01b844-2e21-431a-8b22-8fec0e61bf98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3270439-23a0-43a9-95a7-77a0d76ffd39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260]
Oct 26 09:26:52 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260] successful.
Oct 26 09:26:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1ac469-b9ff-430f-8fbe-4a89ad4e518f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6480f0a2-24d9-4fc2-8ddc-55421dbbcac0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:52 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:26:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:26:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e97bf6-6038-4bca-af6d-7b0a0bd7c96d]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwMZCsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] No VIF found with MAC fa:16:3e:19:fc:e8, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== connect_volume: return (2651ms) {'type': 'block', 'scsi_wwn': '26138363330306662', 'path': '/dev/sdf'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138363330306662', 'path': '/dev/sdf'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUMhJzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:26:54 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:54 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:26:54 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3baede6-7f8f-421c-adcf-57044c0ff7ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:26:54 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f9611-fe44-4e1e-8e0e-11f41efe13e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0] added
Oct 26 09:26:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e07d71f-40a7-4c99-87a1-4afdce5027d3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe233f9-a40a-4eb1-883e-b6b0e322c146]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUMhJzON {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUMhJzON" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fec3a-3531-4b52-be25-342b90124cfc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xUMhJzON'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b25a6-0349-4ef6-8caa-f17176184a0b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3655f168-69db-45f6-b609-e7f8371dbd96]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[80137e2f-634f-4694-b608-d15c20fa29de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260]
Oct 26 09:26:54 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260] successful.
Oct 26 09:26:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b232ee24-af46-4a8a-b065-8d8aab5acabc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4141fd0-4388-4961-bd13-906e9d5ed959]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:26:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[013437a0-588c-41d5-8875-0f6c7b8506b0]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUMhJzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23230303266653937', 'path': '/dev/sdg'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230303266653937', 'path': '/dev/sdg'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lazy-loading 'pci_devices' on Instance uuid 01e34352-139a-446b-a738-f60aae9c02a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:26:55 user nova-compute[74075]:   <uuid>01e34352-139a-446b-a738-f60aae9c02a7</uuid>
Oct 26 09:26:55 user nova-compute[74075]:   <name>instance-0000000a</name>
Oct 26 09:26:55 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:26:55 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:26:55 user nova-compute[74075]:   <metadata>
Oct 26 09:26:55 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:26:55 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:26:55 user nova-compute[74075]:       <nova:name>tempest-device-tagging-server-1696157973</nova:name>
Oct 26 09:26:55 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:26:48</nova:creationTime>
Oct 26 09:26:55 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:26:55 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:26:55 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:26:55 user nova-compute[74075]:       <nova:owner>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:user uuid="c72261377aed422dab1948357f7a035e">tempest-TaggedBootDevicesTest_v242-1232865979-project-member</nova:user>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:project uuid="8bfd8436061f42e88cc89505087c2dab">tempest-TaggedBootDevicesTest_v242-1232865979</nova:project>
Oct 26 09:26:55 user nova-compute[74075]:       </nova:owner>
Oct 26 09:26:55 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:26:55 user nova-compute[74075]:       <nova:ports>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="1096d4b9-0994-4833-9994-7fa46d69e7e1">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="9b67671f-15b1-474f-b542-645d686a9f3a">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="66c963d1-23e3-461b-a474-d735dc246f4f">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="5c47a0fa-616d-4b3c-99f5-421ac07d4259">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="eacd9076-eae3-492a-8b1a-ee98fe10bc17">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:         <nova:port uuid="38db9e7d-1a60-453c-a7fc-90b00e6ae62f">
Oct 26 09:26:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 09:26:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:26:55 user nova-compute[74075]:       </nova:ports>
Oct 26 09:26:55 user nova-compute[74075]:     </nova:instance>
Oct 26 09:26:55 user nova-compute[74075]:   </metadata>
Oct 26 09:26:55 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:26:55 user nova-compute[74075]:     <system>
Oct 26 09:26:55 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:26:55 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:26:55 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:26:55 user nova-compute[74075]:       <entry name="serial">01e34352-139a-446b-a738-f60aae9c02a7</entry>
Oct 26 09:26:55 user nova-compute[74075]:       <entry name="uuid">01e34352-139a-446b-a738-f60aae9c02a7</entry>
Oct 26 09:26:55 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:26:55 user nova-compute[74075]:     </system>
Oct 26 09:26:55 user nova-compute[74075]:   </sysinfo>
Oct 26 09:26:55 user nova-compute[74075]:   <os>
Oct 26 09:26:55 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:26:55 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:26:55 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:26:55 user nova-compute[74075]:   </os>
Oct 26 09:26:55 user nova-compute[74075]:   <features>
Oct 26 09:26:55 user nova-compute[74075]:     <acpi/>
Oct 26 09:26:55 user nova-compute[74075]:     <apic/>
Oct 26 09:26:55 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:26:55 user nova-compute[74075]:   </features>
Oct 26 09:26:55 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:26:55 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:26:55 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:26:55 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:26:55 user nova-compute[74075]:   </clock>
Oct 26 09:26:55 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:26:55 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:26:55 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:26:55 user nova-compute[74075]:   </cpu>
Oct 26 09:26:55 user nova-compute[74075]:   <devices>
Oct 26 09:26:55 user nova-compute[74075]:     <disk type="file" device="cdrom">
Oct 26 09:26:55 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 09:26:55 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7/disk.config"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="hda" bus="ide"/>
Oct 26 09:26:55 user nova-compute[74075]:     </disk>
Oct 26 09:26:55 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:26:55 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:26:55 user nova-compute[74075]:       <source dev="/dev/sdd"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <serial>e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9</serial>
Oct 26 09:26:55 user nova-compute[74075]:     </disk>
Oct 26 09:26:55 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:26:55 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:26:55 user nova-compute[74075]:       <source dev="/dev/sdf"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <serial>243d8798-0c8d-481a-8a9d-20bb69657224</serial>
Oct 26 09:26:55 user nova-compute[74075]:     </disk>
Oct 26 09:26:55 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:26:55 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:26:55 user nova-compute[74075]:       <source dev="/dev/sdg"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="vdc" bus="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <serial>abf27916-77c3-49ba-87a3-45eeb7d5d2b0</serial>
Oct 26 09:26:55 user nova-compute[74075]:     </disk>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:0c:aa:a4"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tap1096d4b9-09"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:a5:b3:af"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tap9b67671f-15"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:6a:d0:ae"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tap66c963d1-23"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:61:ab:0b"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tapbd4c2a14-1e"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:63:97:5f"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tap5c47a0fa-61"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:91:e3:7e"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tapeacd9076-ea"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:26:55 user nova-compute[74075]:       <mac address="fa:16:3e:09:f2:ba"/>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:26:55 user nova-compute[74075]:       <target dev="tap38db9e7d-1a"/>
Oct 26 09:26:55 user nova-compute[74075]:     </interface>
Oct 26 09:26:55 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:26:55 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7/console.log" append="off"/>
Oct 26 09:26:55 user nova-compute[74075]:     </serial>
Oct 26 09:26:55 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:26:55 user nova-compute[74075]:     <video>
Oct 26 09:26:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:26:55 user nova-compute[74075]:     </video>
Oct 26 09:26:55 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:26:55 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:26:55 user nova-compute[74075]:     </rng>
Oct 26 09:26:55 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:26:55 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:26:55 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:26:55 user nova-compute[74075]:     </memballoon>
Oct 26 09:26:55 user nova-compute[74075]:   </devices>
Oct 26 09:26:55 user nova-compute[74075]: </domain>
Oct 26 09:26:55 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f60fdaee-2d0d-589d-8536-c1d9967298e9', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1096d4b9-09, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1096d4b9-09, col_values=(('qos', UUID('2343d558-c352-4ddd-afda-e3677ed6f65b')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1096d4b9-09, col_values=(('external_ids', {'iface-id': '1096d4b9-0994-4833-9994-7fa46d69e7e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:aa:a4', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09')
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f584864f-adf6-5557-a0f3-822c2bc564f0', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b67671f-15, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b67671f-15, col_values=(('qos', UUID('2fc3a432-e5f8-48bc-804a-6f8d0a73005e')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b67671f-15, col_values=(('external_ids', {'iface-id': '9b67671f-15b1-474f-b542-645d686a9f3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:b3:af', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15')
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e49c3485-899c-567e-9ad2-b3bbfbdb9fa6', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66c963d1-23, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66c963d1-23, col_values=(('qos', UUID('5085fbd0-1a72-4224-ae81-fa29090f2e79')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66c963d1-23, col_values=(('external_ids', {'iface-id': '66c963d1-23e3-461b-a474-d735dc246f4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:d0:ae', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23')
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1e0c6b6-5507-5548-bc15-a2cd1ef0c589', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd4c2a14-1e, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd4c2a14-1e, col_values=(('qos', UUID('c1935330-8b92-4c42-9f0f-59a5991b722d')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd4c2a14-1e, col_values=(('external_ids', {'iface-id': 'bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ab:0b', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e')
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f65f16a9-83b9-5157-bfd9-dfe00ea4ee02', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c47a0fa-61, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c47a0fa-61, col_values=(('qos', UUID('0bef3c4f-025c-4f2f-a1f5-e533c45389d6')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c47a0fa-61, col_values=(('external_ids', {'iface-id': '5c47a0fa-616d-4b3c-99f5-421ac07d4259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:97:5f', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61')
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa5d4238-3009-57e3-a84a-b652dc7e9400', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeacd9076-ea, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeacd9076-ea, col_values=(('qos', UUID('d83c1fd1-59f0-44b2-9b7e-477004385d1d')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeacd9076-ea, col_values=(('external_ids', {'iface-id': 'eacd9076-eae3-492a-8b1a-ee98fe10bc17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:e3:7e', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea')
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a16f437-3772-5268-a3df-0e6a7b0ea37f', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38db9e7d-1a, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38db9e7d-1a, col_values=(('qos', UUID('9ac2de6b-48bd-4fbc-830a-fd928a86fa47')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38db9e7d-1a, col_values=(('external_ids', {'iface-id': '38db9e7d-1a60-453c-a7fc-90b00e6ae62f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:f2:ba', 'vm-uuid': '01e34352-139a-446b-a738-f60aae9c02a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: INFO os_vif [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a')
Oct 26 09:26:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] No BDM found with device name hda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] No VIF found with MAC fa:16:3e:0c:aa:a4, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] No VIF found with MAC fa:16:3e:63:97:5f, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:26:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Using config drive
Oct 26 09:26:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Creating config drive at /opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7/disk.config
Oct 26 09:26:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkq64szhf {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:26:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkq64szhf" returned: 0 in 0.053s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-c3f6f540-541a-409b-b09f-34693ac69792 req-bdc45c73-84e4-4bc3-b52b-191a2ede63b8 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c3f6f540-541a-409b-b09f-34693ac69792 req-bdc45c73-84e4-4bc3-b52b-191a2ede63b8 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c3f6f540-541a-409b-b09f-34693ac69792 req-bdc45c73-84e4-4bc3-b52b-191a2ede63b8 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c3f6f540-541a-409b-b09f-34693ac69792 req-bdc45c73-84e4-4bc3-b52b-191a2ede63b8 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-c3f6f540-541a-409b-b09f-34693ac69792 req-bdc45c73-84e4-4bc3-b52b-191a2ede63b8 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:26:58 user nova-compute[74075]: WARNING nova.compute.manager [req-c3f6f540-541a-409b-b09f-34693ac69792 req-bdc45c73-84e4-4bc3-b52b-191a2ede63b8 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 for instance with vm_state building and task_state spawning.
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-c9bee495-2f58-4a55-b2ec-ec928dad441b req-9ee7621c-b085-4911-8f9a-159cae1061df service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c9bee495-2f58-4a55-b2ec-ec928dad441b req-9ee7621c-b085-4911-8f9a-159cae1061df service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c9bee495-2f58-4a55-b2ec-ec928dad441b req-9ee7621c-b085-4911-8f9a-159cae1061df service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c9bee495-2f58-4a55-b2ec-ec928dad441b req-9ee7621c-b085-4911-8f9a-159cae1061df service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-c9bee495-2f58-4a55-b2ec-ec928dad441b req-9ee7621c-b085-4911-8f9a-159cae1061df service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:26:58 user nova-compute[74075]: WARNING nova.compute.manager [req-c9bee495-2f58-4a55-b2ec-ec928dad441b req-9ee7621c-b085-4911-8f9a-159cae1061df service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a for instance with vm_state building and task_state spawning.
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:26:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-ca0b7d01-c7b3-4692-8afe-d9f36758f001 req-d507c555-e35f-49be-ab49-16acd85926d6 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-d78a6630-e951-480c-a561-011d9b5bb8d6 req-989923d8-4b36-476d-a3dc-7acae06771bf service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d78a6630-e951-480c-a561-011d9b5bb8d6 req-989923d8-4b36-476d-a3dc-7acae06771bf service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d78a6630-e951-480c-a561-011d9b5bb8d6 req-989923d8-4b36-476d-a3dc-7acae06771bf service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d78a6630-e951-480c-a561-011d9b5bb8d6 req-989923d8-4b36-476d-a3dc-7acae06771bf service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-d78a6630-e951-480c-a561-011d9b5bb8d6 req-989923d8-4b36-476d-a3dc-7acae06771bf service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-d78a6630-e951-480c-a561-011d9b5bb8d6 req-989923d8-4b36-476d-a3dc-7acae06771bf service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 for instance with vm_state building and task_state spawning.
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:00 user nova-compute[74075]: WARNING nova.compute.manager [req-e1fd7b20-a7ef-491f-aae7-45d521954833 req-16155e6b-8349-4516-960a-85a46c8f89ce service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 for instance with vm_state building and task_state spawning.
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:27:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance spawned successfully.
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:27:02 user nova-compute[74075]: INFO nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Took 13.89 seconds to spawn the instance on the hypervisor.
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-4f0136e0-b6da-4522-9c2f-8d2ca9db62a9 req-7bad0bc0-5104-4d1b-86ee-6bb02763046f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4f0136e0-b6da-4522-9c2f-8d2ca9db62a9 req-7bad0bc0-5104-4d1b-86ee-6bb02763046f service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4f0136e0-b6da-4522-9c2f-8d2ca9db62a9 req-7bad0bc0-5104-4d1b-86ee-6bb02763046f service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4f0136e0-b6da-4522-9c2f-8d2ca9db62a9 req-7bad0bc0-5104-4d1b-86ee-6bb02763046f service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-4f0136e0-b6da-4522-9c2f-8d2ca9db62a9 req-7bad0bc0-5104-4d1b-86ee-6bb02763046f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:02 user nova-compute[74075]: WARNING nova.compute.manager [req-4f0136e0-b6da-4522-9c2f-8d2ca9db62a9 req-7bad0bc0-5104-4d1b-86ee-6bb02763046f service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f for instance with vm_state building and task_state spawning.
Oct 26 09:27:02 user nova-compute[74075]: INFO nova.compute.manager [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Took 89.44 seconds to build instance.
Oct 26 09:27:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aca2da06-6b55-40e7-95b7-4eb461e73e43 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "01e34352-139a-446b-a738-f60aae9c02a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 89.554s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:27:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:27:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:27:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:27:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucRrZKMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:23 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:23 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:23 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[06481c07-7436-4489-9a55-9482ae30e4db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:27:23 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7861615b-583c-4ad1-aca4-f393919f6eb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226] added
Oct 26 09:27:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b86ff1-854e-4a31-9237-b4f9a7f39277]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bed123d-4827-449a-b94a-6330047e8160]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucRrZKMJ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucRrZKMJ" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[40739507-f770-428a-932e-0af2518c08ca]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucRrZKMJ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32bd113-ff2d-457c-97c7-2adaeeaaa289]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c3b1f-c130-4f26-8583-269a40e92e4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-585e772e-cb72-42a0-8409-ad93261f3e5a tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 74.113s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[38121993-8aca-43f8-a849-20a769c135f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260]
Oct 26 09:27:23 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2152d4-1fbd-4029-a7d3-70da47703874]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f22973-cda9-4d27-a1b3-0486b1f9955f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3742a-debc-4e93-890f-cee5d0432bd9]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucRrZKMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:27:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4f5bc60c-c690-41e4-aa3b-4c10c4a5d9ae tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.324s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26263396264303364', 'path': '/dev/sdh'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263396264303364', 'path': '/dev/sdh'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:27:24 user nova-compute[74075]: DEBUG nova.objects.instance [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lazy-loading 'flavor' on Instance uuid 8fde35bc-f050-40fa-8975-b10691739658 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:27:24 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:24 user nova-compute[74075]:   <source dev="/dev/sdh"/>
Oct 26 09:27:24 user nova-compute[74075]:   <target dev="sdc" bus="scsi"/>
Oct 26 09:27:24 user nova-compute[74075]:   <serial>f083ca07-6ca3-4318-b752-244569d28226</serial>
Oct 26 09:27:24 user nova-compute[74075]:   <address type="drive" controller="0" unit="2"/>
Oct 26 09:27:24 user nova-compute[74075]: </disk>
Oct 26 09:27:24 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No BDM found with device name sda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] No VIF found with MAC fa:16:3e:41:1c:d3, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da7c267b-28b2-4bcb-a837-4f877b40cdeb tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.773s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG os_brick.utils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3130b8b1-e6b5-4373-b4ae-a6f57112a473]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[965f6c7c-6c08-42a6-babb-b8fe9d5a7571]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8cf69-d4f0-4584-ad85-e247f7821829]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9db70a-b6ee-499d-8abe-8bbe59eb8e87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:27:25 user nova-compute[74075]: INFO nova.compute.manager [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Detaching volume 76863e16-7e2c-4458-a4cf-6ced7c373b44
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:27:25 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:27:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a1c0e-fa52-400b-a760-b7fe38d84a14]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG os_brick.utils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:25 user nova-compute[74075]: INFO nova.virt.block_device [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Attempting to driver detach volume 76863e16-7e2c-4458-a4cf-6ced7c373b44 from mountpoint /dev/vdb
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Attempting to detach device vdb from instance 17b8e7c7-a424-4101-86eb-c62708543f06 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:25 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:25 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:27:25 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:25 user nova-compute[74075]:   <serial>76863e16-7e2c-4458-a4cf-6ced7c373b44</serial>
Oct 26 09:27:25 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:27:25 user nova-compute[74075]: </disk>
Oct 26 09:27:25 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:25 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Successfully detached device vdb from instance 17b8e7c7-a424-4101-86eb-c62708543f06 from the persistent domain config.
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b8e7c7-a424-4101-86eb-c62708543f06 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:27:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:25 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:25 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:27:25 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:25 user nova-compute[74075]:   <serial>76863e16-7e2c-4458-a4cf-6ced7c373b44</serial>
Oct 26 09:27:25 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:27:25 user nova-compute[74075]: </disk>
Oct 26 09:27:25 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:25 user nova-compute[74075]: INFO nova.compute.manager [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Swapping volume 2901dbbf-756a-482c-99f0-a70ea04cffcd for 1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:27:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:27:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwtYzsMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:32 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:32 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:32 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[269cbc2f-2fd3-4ba6-b6a9-05e98d31960b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:27:32 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfkWQHeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:32 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367f1d3-ffee-4088-b166-43e84a05eee2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1] added
Oct 26 09:27:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2720e911-d1ae-4adf-8932-ceace2ca5f04]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9bbf96-6c18-4ca6-a9e5-531530780bec]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwtYzsMp {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwtYzsMp" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d0f6d-5fe8-4f24-b1c7-129ad350fdec]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwtYzsMp'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315c9fd-09e4-4dfd-bff8-be04934fe473]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac651c7-d6d0-4b86-af9d-d13acd682c04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fa42c0-65b0-4af9-8f2f-14c5b31252be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260]
Oct 26 09:27:32 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[02952158-1000-4c69-8f72-a7f87e72599f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[18496433-c254-4345-9d58-770fcfa1c78b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf59f02-555f-4197-b28f-9775d76f190f]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwtYzsMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:27:32 user nova-compute[74075]: INFO nova.compute.manager [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Detaching volume f083ca07-6ca3-4318-b752-244569d28226
Oct 26 09:27:32 user nova-compute[74075]: INFO nova.virt.block_device [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Attempting to driver detach volume f083ca07-6ca3-4318-b752-244569d28226 from mountpoint /dev/sdc
Oct 26 09:27:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Attempting to detach device sdc from instance 8fde35bc-f050-40fa-8975-b10691739658 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:32 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:32 user nova-compute[74075]:   <source dev="/dev/sdh"/>
Oct 26 09:27:32 user nova-compute[74075]:   <target dev="sdc" bus="scsi"/>
Oct 26 09:27:32 user nova-compute[74075]:   <serial>f083ca07-6ca3-4318-b752-244569d28226</serial>
Oct 26 09:27:32 user nova-compute[74075]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 09:27:32 user nova-compute[74075]: </disk>
Oct 26 09:27:32 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Successfully detached device sdc from instance 8fde35bc-f050-40fa-8975-b10691739658 from the persistent domain config.
Oct 26 09:27:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8fde35bc-f050-40fa-8975-b10691739658 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:27:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:32 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:32 user nova-compute[74075]:   <source dev="/dev/sdh"/>
Oct 26 09:27:32 user nova-compute[74075]:   <target dev="sdc" bus="scsi"/>
Oct 26 09:27:32 user nova-compute[74075]:   <serial>f083ca07-6ca3-4318-b752-244569d28226</serial>
Oct 26 09:27:32 user nova-compute[74075]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 09:27:32 user nova-compute[74075]: </disk>
Oct 26 09:27:32 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8fde35bc-f050-40fa-8975-b10691739658 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23162663566333031', 'path': '/dev/sdi'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162663566333031', 'path': '/dev/sdi'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.348s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:33 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:33 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'flavor' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ae34d-db68-4e8e-a240-86bae39e9d43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:27:33 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:27:33 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:33 user nova-compute[74075]:   <source dev="/dev/sdi"/>
Oct 26 09:27:33 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:33 user nova-compute[74075]:   <serial>c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1</serial>
Oct 26 09:27:33 user nova-compute[74075]: </disk>
Oct 26 09:27:33 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[81114e2c-360e-404a-856d-711a3f6d1e13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe] added
Oct 26 09:27:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d6f50f-a649-4702-adc6-757079f5336d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba6dd1-64e5-41b3-992c-c2f1e21fc093]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfkWQHeN {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfkWQHeN" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fa6dc-3184-43b9-af25-e41b4fff2533]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dfkWQHeN'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[85664369-4a10-4429-9622-d211c9092868]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ed8c05-79be-43fd-bef4-e007e4392c91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60a71b-ebd5-4837-baaa-bfe3a1b93025]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260]
Oct 26 09:27:34 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:34 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a1f49-a7eb-4923-a8fa-5e2938d3bb62]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf42a21-cb70-4fe8-88bb-5f9486b98cc9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:34 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfee8145-238a-418a-ac0c-fa7b0c3303a0]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No BDM found with device name hda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] No VIF found with MAC fa:16:3e:a2:4b:20, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f9a5534-7768-4ebc-8b59-59832cd470b0 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.008s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfkWQHeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] <== connect_volume: return (2717ms) {'type': 'block', 'scsi_wwn': '23364346236643066', 'path': '/dev/sdj'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364346236643066', 'path': '/dev/sdj'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.objects.instance [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lazy-loading 'flavor' on Instance uuid dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] attach device xml: <disk type="block" device="disk">
Oct 26 09:27:35 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:35 user nova-compute[74075]:   <source dev="/dev/sdj"/>
Oct 26 09:27:35 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:35 user nova-compute[74075]:   <serial>b92989b3-b93e-4aa9-bf09-345ae037cbbe</serial>
Oct 26 09:27:35 user nova-compute[74075]: </disk>
Oct 26 09:27:35 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] No VIF found with MAC fa:16:3e:64:8c:05, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:35 user nova-compute[74075]: INFO nova.compute.manager [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Detaching volume c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1
Oct 26 09:27:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-889acc58-f265-4693-b73a-98fcb1f8fe40 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.160s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:35 user nova-compute[74075]: INFO nova.virt.block_device [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Attempting to driver detach volume c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 from mountpoint /dev/vdb
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Attempting to detach device vdb from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:35 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:35 user nova-compute[74075]:   <source dev="/dev/sdi"/>
Oct 26 09:27:35 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:35 user nova-compute[74075]:   <serial>c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1</serial>
Oct 26 09:27:35 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 09:27:35 user nova-compute[74075]: </disk>
Oct 26 09:27:35 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully detached device vdb from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the persistent domain config.
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:27:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:35 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:35 user nova-compute[74075]:   <source dev="/dev/sdi"/>
Oct 26 09:27:35 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:35 user nova-compute[74075]:   <serial>c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1</serial>
Oct 26 09:27:35 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 09:27:35 user nova-compute[74075]: </disk>
Oct 26 09:27:35 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] volume_snapshot_create: create_info: {'snapshot_id': '0e3cc1d0-bc3f-4046-9a0f-8b35b9801f0d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74075) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] snap xml: <domainsnapshot>
Oct 26 09:27:36 user nova-compute[74075]:   <disks>
Oct 26 09:27:36 user nova-compute[74075]:     <disk name="/dev/sdj" snapshot="external" type="file">
Oct 26 09:27:36 user nova-compute[74075]:       <source file="/dev/new_file"/>
Oct 26 09:27:36 user nova-compute[74075]:     </disk>
Oct 26 09:27:36 user nova-compute[74075]:     <disk name="vda" snapshot="no"/>
Oct 26 09:27:36 user nova-compute[74075]:   </disks>
Oct 26 09:27:36 user nova-compute[74075]: </domainsnapshot>
Oct 26 09:27:36 user nova-compute[74075]:  {{(pid=74075) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.objects.instance [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] Lazy-loading 'system_metadata' on Instance uuid dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     rv = execute(f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     six.reraise(c, e, tb)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     raise value
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     rv = meth(*args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     self._volume_snapshot_create(context, instance, guest,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     rv = execute(f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     six.reraise(c, e, tb)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     raise value
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     rv = meth(*args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] 
Oct 26 09:27:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-efbf71a2-0d8c-4dba-977f-1144c77d9a11 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] volume_snapshot_delete: delete_info: {'volume_id': 'b92989b3-b93e-4aa9-bf09-345ae037cbbe'} {{(pid=74075) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [None req-efbf71a2-0d8c-4dba-977f-1144c77d9a11 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5]     if delete_info['type'] != 'qcow2':
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] KeyError: 'type'
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] 
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 0e3cc1d0-bc3f-4046-9a0f-8b35b9801f0d could not be found.
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise value
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 0e3cc1d0-bc3f-4046-9a0f-8b35b9801f0d could not be found. (HTTP 404) (Request-ID: req-6f3cd011-f388-4e75-b6b2-c03d6df6ff35)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 0e3cc1d0-bc3f-4046-9a0f-8b35b9801f0d could not be found.
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server [None req-451d5eeb-1260-479e-8391-d57f724f47c9 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise value
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver [None req-efbf71a2-0d8c-4dba-977f-1144c77d9a11 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-afcf503d-6e6a-400c-be4e-57f9bb9c8456)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 09:27:36 user nova-compute[74075]: ERROR nova.virt.libvirt.driver 
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server [None req-efbf71a2-0d8c-4dba-977f-1144c77d9a11 tempest-VolumesAssistedSnapshotsTest-653880593 tempest-VolumesAssistedSnapshotsTest-653880593-project] Exception during message handling: KeyError: 'type'
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 26 09:27:36 user nova-compute[74075]: ERROR oslo_messaging.rpc.server 
Oct 26 09:27:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:36 user nova-compute[74075]: INFO nova.compute.manager [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Detaching volume b92989b3-b93e-4aa9-bf09-345ae037cbbe
Oct 26 09:27:36 user nova-compute[74075]: INFO nova.virt.block_device [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Attempting to driver detach volume b92989b3-b93e-4aa9-bf09-345ae037cbbe from mountpoint /dev/vdb
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Attempting to detach device vdb from instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:36 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:36 user nova-compute[74075]:   <source dev="/dev/sdj"/>
Oct 26 09:27:36 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:36 user nova-compute[74075]:   <serial>b92989b3-b93e-4aa9-bf09-345ae037cbbe</serial>
Oct 26 09:27:36 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:27:36 user nova-compute[74075]: </disk>
Oct 26 09:27:36 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Successfully detached device vdb from instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 from the persistent domain config.
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:27:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 09:27:36 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:27:36 user nova-compute[74075]:   <source dev="/dev/sdj"/>
Oct 26 09:27:36 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:27:36 user nova-compute[74075]:   <serial>b92989b3-b93e-4aa9-bf09-345ae037cbbe</serial>
Oct 26 09:27:36 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:27:36 user nova-compute[74075]: </disk>
Oct 26 09:27:36 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:27:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:46 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b8e7c7-a424-4101-86eb-c62708543f06 is timed out.
Oct 26 09:27:46 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Successfully detached device vdb from instance 17b8e7c7-a424-4101-86eb-c62708543f06 from the live domain config.
Oct 26 09:27:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNuFOlVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:46 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b68a9-b376-4de3-a1c5-97d3953ddb44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:27:46 user nova-compute[74075]: No targets found.
Oct 26 09:27:46 user nova-compute[74075]: iSNS:
Oct 26 09:27:46 user nova-compute[74075]: No targets found.
Oct 26 09:27:46 user nova-compute[74075]: STATIC:
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44
Oct 26 09:27:46 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:46 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:46 user nova-compute[74075]: FIRMWARE:
Oct 26 09:27:46 user nova-compute[74075]: No targets found.
Oct 26 09:27:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:27:46 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:27:46 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdee43a-a855-4384-9d47-d39018a7c695]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c4ab13-31bc-41e8-97ec-ed1df7f7a4d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f465c122680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101628c-65fd-417b-9f3b-bffe71941735]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c371897-d60e-4a86-bc6e-fb997be26526]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef704f2-6fe2-4ae0-9734-878175ab3e32]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c1909-ad9b-42ec-9f9e-84cda595039f]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[39152307-92f6-47b2-a9e8-b004158a5239]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd87b4a-b6b3-4a4c-8e30-9ad59618bdc8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260]
Oct 26 09:27:46 user nova-compute[74075]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76863e16-7e2c-4458-a4cf-6ced7c373b44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8e6c94-dea7-41a7-ad3b-e0daf69c57d4]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] <== disconnect_volume: return (396ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG nova.objects.instance [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lazy-loading 'flavor' on Instance uuid 5b47826e-624e-4045-b5bc-2b764caf3d25 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.155s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:50 user nova-compute[74075]: INFO nova.compute.manager [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Attaching volume f67179c2-9921-46cb-9016-e583b7cc1865 to /dev/vdb
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG os_brick.utils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e994e4-5c10-4dd1-9f45-dc6923d2e05a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe8784-f5c5-44ae-92a8-a07f9f6b6f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6653c56d-5620-4e66-882d-dbc44cf51d64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7c1af6-9ebb-4096-b9bb-5b45e7cfb93c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:27:51 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a406357c-bc06-449e-a075-ef002b34f1c4]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.utils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating existing volume attachment record: 24ee1ca0-58a4-453a-9394-f1163b40deae {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCtQISFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0', 'attached_at': '', 'detached_at': '', 'volume_id': '1a3a7498-7bd8-42ca-9704-12123def206d', 'serial': '1a3a7498-7bd8-42ca-9704-12123def206d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2901dbbf-756a-482c-99f0-a70ea04cffcd', 'serial'} {{(pid=74075) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCtQISFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:51 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28477e9d-a238-423c-9d6a-b83414bd29c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:27:51 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a15cd32-ab4d-44e2-82be-695496a9b858]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d] added
Oct 26 09:27:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53f9d81-120c-4822-9891-dc136dae5f15]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82c9cb-6b0b-45e1-b162-df3a07a47221]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCtQISFP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCtQISFP" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac3b565-6559-49b4-afd2-0446cfba9079]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCtQISFP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f42d1e-9504-4e82-8fa2-6e752071dff6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0654bc-a130-4b0c-bf5e-b421b330f93f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:51 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857e4cb-1a81-4a78-941f-3cf52933f899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260]
Oct 26 09:27:52 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a51d3ef-18c7-44bc-a9a6-875d2ec6e32d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:27:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.52450942993164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7fc96b-4ce2-4053-bc8b-92e70b6f0961]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.889s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa73a52-dd6a-4514-8b11-25c153a3062d]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCtQISFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8fde35bc-f050-40fa-8975-b10691739658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 01e34352-139a-446b-a738-f60aae9c02a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:27:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 8fde35bc-f050-40fa-8975-b10691739658 is timed out.
Oct 26 09:27:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Successfully detached device sdc from instance 8fde35bc-f050-40fa-8975-b10691739658 from the live domain config.
Oct 26 09:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucRrZKMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.929s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] <== connect_volume: return (1932ms) {'type': 'block', 'scsi_wwn': '26266356162663531', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266356162663531', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.363s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lazy-loading 'flavor' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6634563-12ce-4c87-b236-c11e0fe06a50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:27:53 user nova-compute[74075]: No targets found.
Oct 26 09:27:53 user nova-compute[74075]: iSNS:
Oct 26 09:27:53 user nova-compute[74075]: No targets found.
Oct 26 09:27:53 user nova-compute[74075]: STATIC:
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:27:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:53 user nova-compute[74075]: FIRMWARE:
Oct 26 09:27:53 user nova-compute[74075]: No targets found.
Oct 26 09:27:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:27:53 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:27:53 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783864d-6c29-4f3f-8ce0-444b9a2212eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[793623b6-75c9-49bb-8a49-223633a5c492]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c280430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226'): ({'sdh'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Removing single pathed devices sdh {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e1a829-8aa1-4daf-95c9-a8cfec3f9f6b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e585165a-f67d-412a-850c-0cedcfc08c32]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Flushing IO for device /dev/sdh {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[97428a04-33fa-4d86-8394-8c58f06576fd]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c80caa-90b1-4a82-91ff-74418a0a2500]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] SCSI volumes sdh have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a697dd2-96c8-46ae-914d-2b87e6bb431f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4f645-d38b-4d91-8d04-8b9a9d24726b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260]
Oct 26 09:27:54 user nova-compute[74075]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f083ca07-6ca3-4318-b752-244569d28226 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf02fcf7-0eb7-4acc-aafe-4abac335f859]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] <== disconnect_volume: return (755ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: e4baa273-79c9-408c-9c41-17e202582246] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 179306496 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:27:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:27:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 419430400 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'flavor' on Instance uuid 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-45aa6b79-5fa0-4f63-a47f-d3f53377a587 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.369s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 541065216 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:27:56 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce is timed out.
Oct 26 09:27:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully detached device vdb from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the live domain config.
Oct 26 09:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwtYzsMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:56 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef69c29-2b78-400c-851a-e85574515dd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:27:56 user nova-compute[74075]: No targets found.
Oct 26 09:27:56 user nova-compute[74075]: iSNS:
Oct 26 09:27:56 user nova-compute[74075]: No targets found.
Oct 26 09:27:56 user nova-compute[74075]: STATIC:
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:27:56 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:56 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:56 user nova-compute[74075]: FIRMWARE:
Oct 26 09:27:56 user nova-compute[74075]: No targets found.
Oct 26 09:27:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:27:56 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:27:56 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d47655-9ef8-42ea-b93a-466e56c4364e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe2fe74-a79e-4aba-95c3-534c2faaa123]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 (non-flash)
Oct 26 09:27:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c282c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1'): ({'sdi'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Removing single pathed devices sdi {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[046afc81-981e-422e-9244-9d55dea9b250]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bfdad5-b3e2-4561-8058-4c7ca0d5bc46]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Flushing IO for device /dev/sdi {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e4c57-e627-4b25-9a5d-0937bea739b8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cb1545-97a2-4ba1-809b-aa3352c59f44]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] SCSI volumes sdi have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cffb774-6766-4a1c-a6fc-40dba3a0894f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18e6bca-146e-48a9-aa27-debb90bf92c2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260]
Oct 26 09:27:56 user nova-compute[74075]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a6437d-3b8d-4b36-99d5-ac02c0f81ae1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba93b50-7799-4687-9216-33e58d6b91a7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] <== disconnect_volume: return (434ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 808452096 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:57 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 is timed out.
Oct 26 09:27:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Successfully detached device vdb from instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 from the live domain config.
Oct 26 09:27:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfkWQHeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:57 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a09d6-8881-4ba1-a7dd-547f13a18503]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:27:57 user nova-compute[74075]: No targets found.
Oct 26 09:27:57 user nova-compute[74075]: iSNS:
Oct 26 09:27:57 user nova-compute[74075]: No targets found.
Oct 26 09:27:57 user nova-compute[74075]: STATIC:
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:27:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:57 user nova-compute[74075]: FIRMWARE:
Oct 26 09:27:57 user nova-compute[74075]: No targets found.
Oct 26 09:27:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:27:57 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:27:57 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea33f64-6a56-40d7-8f95-3a2d6ef8bd04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40479ff-563f-439c-b28e-786fd3bb9418]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:57 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f465c3d3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe'): ({'sdj'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Removing single pathed devices sdj {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550b47b-707b-44a0-800b-22a9ef2bbcfd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259baf9-237f-4e5b-a342-ae6a60134878]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Flushing IO for device /dev/sdj {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4e860-7ac9-451d-89f9-3fecfbd4a157]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d51327-a73f-497f-8253-952f813efa82]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] SCSI volumes sdj have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28048cd8-b29a-4867-83a0-7248191438b3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 808452096 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac10af88-5446-4b8e-a3f6-6ac35899c2d1]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260]
Oct 26 09:27:57 user nova-compute[74075]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b92989b3-b93e-4aa9-bf09-345ae037cbbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[214d997e-f656-4ef9-b531-19e2c42a6abd]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] <== disconnect_volume: return (324ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:27:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 912261120 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 1006632960 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'flavor' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e066b351-6575-4e81-b3db-007bbcdde91f tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.167s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "interface-8a38837e-a0c6-43c2-af40-ad1db9d651ce-9c70564e-8e15-4072-92f9-72bd83d016e1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "interface-8a38837e-a0c6-43c2-af40-ad1db9d651ce-9c70564e-8e15-4072-92f9-72bd83d016e1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.objects.instance [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'flavor' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:16:65:17"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c70564e-8e"/></interface> {{(pid=74075) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:16:65:17"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c70564e-8e"/></interface> {{(pid=74075) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Attempting to detach device tap9c70564e-8e from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] detach device xml: <interface type="ethernet">
Oct 26 09:27:59 user nova-compute[74075]:   <mac address="fa:16:3e:16:65:17"/>
Oct 26 09:27:59 user nova-compute[74075]:   <model type="virtio"/>
Oct 26 09:27:59 user nova-compute[74075]:   <mtu size="1442"/>
Oct 26 09:27:59 user nova-compute[74075]:   <target dev="tap9c70564e-8e"/>
Oct 26 09:27:59 user nova-compute[74075]: </interface>
Oct 26 09:27:59 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:16:65:17"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c70564e-8e"/></interface> {{(pid=74075) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:16:65:17"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c70564e-8e"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 26 09:27:59 user nova-compute[74075]:   <name>instance-00000008</name>
Oct 26 09:27:59 user nova-compute[74075]:   <uuid>8a38837e-a0c6-43c2-af40-ad1db9d651ce</uuid>
Oct 26 09:27:59 user nova-compute[74075]:   <metadata>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:27:59 user nova-compute[74075]:   <nova:package version="0.0.0"/>
Oct 26 09:27:59 user nova-compute[74075]:   <nova:name>tempest-device-tagging-server-1189807003</nova:name>
Oct 26 09:27:59 user nova-compute[74075]:   <nova:creationTime>2023-10-26 09:26:25</nova:creationTime>
Oct 26 09:27:59 user nova-compute[74075]:   <nova:flavor name="m1.tiny">
Oct 26 09:27:59 user nova-compute[74075]:     <nova:memory>512</nova:memory>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:disk>1</nova:disk>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:swap>0</nova:swap>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:vcpus>1</nova:vcpus>
Oct 26 09:27:59 user nova-compute[74075]:   </nova:flavor>
Oct 26 09:27:59 user nova-compute[74075]:   <nova:owner>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:user uuid="f1e51f861aca4648bd3076ac06369d7a">tempest-TaggedAttachmentsTest-1885075461-project-member</nova:user>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:project uuid="a90cafbb4d16495b834e4972d0ff2004">tempest-TaggedAttachmentsTest-1885075461</nova:project>
Oct 26 09:27:59 user nova-compute[74075]:   </nova:owner>
Oct 26 09:27:59 user nova-compute[74075]:   <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:27:59 user nova-compute[74075]:   <nova:ports>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:port uuid="7525d4cf-2e19-4d31-8f4c-61c0a6de017e">
Oct 26 09:27:59 user nova-compute[74075]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:27:59 user nova-compute[74075]:     </nova:port>
Oct 26 09:27:59 user nova-compute[74075]:     <nova:port uuid="9c70564e-8e15-4072-92f9-72bd83d016e1">
Oct 26 09:27:59 user nova-compute[74075]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 26 09:27:59 user nova-compute[74075]:     </nova:port>
Oct 26 09:27:59 user nova-compute[74075]:   </nova:ports>
Oct 26 09:27:59 user nova-compute[74075]: </nova:instance>
Oct 26 09:27:59 user nova-compute[74075]:   </metadata>
Oct 26 09:27:59 user nova-compute[74075]:   <memory unit='KiB'>524288</memory>
Oct 26 09:27:59 user nova-compute[74075]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 09:27:59 user nova-compute[74075]:   <vcpu placement='static'>1</vcpu>
Oct 26 09:27:59 user nova-compute[74075]:   <resource>
Oct 26 09:27:59 user nova-compute[74075]:     <partition>/machine</partition>
Oct 26 09:27:59 user nova-compute[74075]:   </resource>
Oct 26 09:27:59 user nova-compute[74075]:   <sysinfo type='smbios'>
Oct 26 09:27:59 user nova-compute[74075]:     <system>
Oct 26 09:27:59 user nova-compute[74075]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 09:27:59 user nova-compute[74075]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 09:27:59 user nova-compute[74075]:       <entry name='version'>0.0.0</entry>
Oct 26 09:27:59 user nova-compute[74075]:       <entry name='serial'>8a38837e-a0c6-43c2-af40-ad1db9d651ce</entry>
Oct 26 09:27:59 user nova-compute[74075]:       <entry name='uuid'>8a38837e-a0c6-43c2-af40-ad1db9d651ce</entry>
Oct 26 09:27:59 user nova-compute[74075]:       <entry name='family'>Virtual Machine</entry>
Oct 26 09:27:59 user nova-compute[74075]:     </system>
Oct 26 09:27:59 user nova-compute[74075]:   </sysinfo>
Oct 26 09:27:59 user nova-compute[74075]:   <os>
Oct 26 09:27:59 user nova-compute[74075]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 09:27:59 user nova-compute[74075]:     <boot dev='hd'/>
Oct 26 09:27:59 user nova-compute[74075]:     <smbios mode='sysinfo'/>
Oct 26 09:27:59 user nova-compute[74075]:   </os>
Oct 26 09:27:59 user nova-compute[74075]:   <features>
Oct 26 09:27:59 user nova-compute[74075]:     <acpi/>
Oct 26 09:27:59 user nova-compute[74075]:     <apic/>
Oct 26 09:27:59 user nova-compute[74075]:     <vmcoreinfo state='on'/>
Oct 26 09:27:59 user nova-compute[74075]:   </features>
Oct 26 09:27:59 user nova-compute[74075]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 09:27:59 user nova-compute[74075]:     <model fallback='forbid'>Nehalem</model>
Oct 26 09:27:59 user nova-compute[74075]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 09:27:59 user nova-compute[74075]:     <feature policy='require' name='vme'/>
Oct 26 09:27:59 user nova-compute[74075]:     <feature policy='require' name='x2apic'/>
Oct 26 09:27:59 user nova-compute[74075]:     <feature policy='require' name='hypervisor'/>
Oct 26 09:27:59 user nova-compute[74075]:   </cpu>
Oct 26 09:27:59 user nova-compute[74075]:   <clock offset='utc'>
Oct 26 09:27:59 user nova-compute[74075]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 09:27:59 user nova-compute[74075]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 09:27:59 user nova-compute[74075]:     <timer name='hpet' present='no'/>
Oct 26 09:27:59 user nova-compute[74075]:   </clock>
Oct 26 09:27:59 user nova-compute[74075]:   <on_poweroff>destroy</on_poweroff>
Oct 26 09:27:59 user nova-compute[74075]:   <on_reboot>restart</on_reboot>
Oct 26 09:27:59 user nova-compute[74075]:   <on_crash>destroy</on_crash>
Oct 26 09:27:59 user nova-compute[74075]:   <devices>
Oct 26 09:27:59 user nova-compute[74075]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 09:27:59 user nova-compute[74075]:     <disk type='file' device='disk'>
Oct 26 09:27:59 user nova-compute[74075]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 09:27:59 user nova-compute[74075]:       <source file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk' index='2'/>
Oct 26 09:27:59 user nova-compute[74075]:       <backingStore type='file' index='3'>
Oct 26 09:27:59 user nova-compute[74075]:         <format type='raw'/>
Oct 26 09:27:59 user nova-compute[74075]:         <source file='/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f'/>
Oct 26 09:27:59 user nova-compute[74075]:         <backingStore/>
Oct 26 09:27:59 user nova-compute[74075]:       </backingStore>
Oct 26 09:27:59 user nova-compute[74075]:       <target dev='vda' bus='virtio'/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='virtio-disk0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </disk>
Oct 26 09:27:59 user nova-compute[74075]:     <disk type='file' device='cdrom'>
Oct 26 09:27:59 user nova-compute[74075]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 09:27:59 user nova-compute[74075]:       <source file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.config' index='1'/>
Oct 26 09:27:59 user nova-compute[74075]:       <backingStore/>
Oct 26 09:27:59 user nova-compute[74075]:       <target dev='hda' bus='ide'/>
Oct 26 09:27:59 user nova-compute[74075]:       <readonly/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='ide0-0-0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </disk>
Oct 26 09:27:59 user nova-compute[74075]:     <controller type='usb' index='0' model='none'>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='usb'/>
Oct 26 09:27:59 user nova-compute[74075]:     </controller>
Oct 26 09:27:59 user nova-compute[74075]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='pci.0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </controller>
Oct 26 09:27:59 user nova-compute[74075]:     <controller type='ide' index='0'>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='ide'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 09:27:59 user nova-compute[74075]:     </controller>
Oct 26 09:27:59 user nova-compute[74075]:     <interface type='ethernet'>
Oct 26 09:27:59 user nova-compute[74075]:       <mac address='fa:16:3e:a2:4b:20'/>
Oct 26 09:27:59 user nova-compute[74075]:       <target dev='tap7525d4cf-2e'/>
Oct 26 09:27:59 user nova-compute[74075]:       <model type='virtio'/>
Oct 26 09:27:59 user nova-compute[74075]:       <mtu size='1442'/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='net0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </interface>
Oct 26 09:27:59 user nova-compute[74075]:     <interface type='ethernet'>
Oct 26 09:27:59 user nova-compute[74075]:       <mac address='fa:16:3e:16:65:17'/>
Oct 26 09:27:59 user nova-compute[74075]:       <target dev='tap9c70564e-8e'/>
Oct 26 09:27:59 user nova-compute[74075]:       <model type='virtio'/>
Oct 26 09:27:59 user nova-compute[74075]:       <mtu size='1442'/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='net1'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </interface>
Oct 26 09:27:59 user nova-compute[74075]:     <serial type='pty'>
Oct 26 09:27:59 user nova-compute[74075]:       <source path='/dev/pts/7'/>
Oct 26 09:27:59 user nova-compute[74075]:       <log file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/console.log' append='off'/>
Oct 26 09:27:59 user nova-compute[74075]:       <target type='isa-serial' port='0'>
Oct 26 09:27:59 user nova-compute[74075]:         <model name='isa-serial'/>
Oct 26 09:27:59 user nova-compute[74075]:       </target>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='serial0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </serial>
Oct 26 09:27:59 user nova-compute[74075]:     <console type='pty' tty='/dev/pts/7'>
Oct 26 09:27:59 user nova-compute[74075]:       <source path='/dev/pts/7'/>
Oct 26 09:27:59 user nova-compute[74075]:       <log file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/console.log' append='off'/>
Oct 26 09:27:59 user nova-compute[74075]:       <target type='serial' port='0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='serial0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </console>
Oct 26 09:27:59 user nova-compute[74075]:     <input type='mouse' bus='ps2'>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='input0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </input>
Oct 26 09:27:59 user nova-compute[74075]:     <input type='keyboard' bus='ps2'>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='input1'/>
Oct 26 09:27:59 user nova-compute[74075]:     </input>
Oct 26 09:27:59 user nova-compute[74075]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 26 09:27:59 user nova-compute[74075]:       <listen type='address' address='0.0.0.0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </graphics>
Oct 26 09:27:59 user nova-compute[74075]:     <audio id='1' type='none'/>
Oct 26 09:27:59 user nova-compute[74075]:     <video>
Oct 26 09:27:59 user nova-compute[74075]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='video0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </video>
Oct 26 09:27:59 user nova-compute[74075]:     <memballoon model='virtio'>
Oct 26 09:27:59 user nova-compute[74075]:       <stats period='10'/>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='balloon0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </memballoon>
Oct 26 09:27:59 user nova-compute[74075]:     <rng model='virtio'>
Oct 26 09:27:59 user nova-compute[74075]:       <backend model='random'>/dev/urandom</backend>
Oct 26 09:27:59 user nova-compute[74075]:       <alias name='rng0'/>
Oct 26 09:27:59 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 09:27:59 user nova-compute[74075]:     </rng>
Oct 26 09:27:59 user nova-compute[74075]:   </devices>
Oct 26 09:27:59 user nova-compute[74075]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 09:27:59 user nova-compute[74075]:     <label>libvirt-8a38837e-a0c6-43c2-af40-ad1db9d651ce</label>
Oct 26 09:27:59 user nova-compute[74075]:     <imagelabel>libvirt-8a38837e-a0c6-43c2-af40-ad1db9d651ce</imagelabel>
Oct 26 09:27:59 user nova-compute[74075]:   </seclabel>
Oct 26 09:27:59 user nova-compute[74075]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 09:27:59 user nova-compute[74075]:     <label>+64055:+108</label>
Oct 26 09:27:59 user nova-compute[74075]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 09:27:59 user nova-compute[74075]:   </seclabel>
Oct 26 09:27:59 user nova-compute[74075]: </domain>
Oct 26 09:27:59 user nova-compute[74075]:  {{(pid=74075) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 09:27:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully detached device tap9c70564e-8e from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the persistent domain config.
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] (1/8): Attempting to detach device tap9c70564e-8e with device alias net1 from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] detach device xml: <interface type="ethernet">
Oct 26 09:27:59 user nova-compute[74075]:   <mac address="fa:16:3e:16:65:17"/>
Oct 26 09:27:59 user nova-compute[74075]:   <model type="virtio"/>
Oct 26 09:27:59 user nova-compute[74075]:   <mtu size="1442"/>
Oct 26 09:27:59 user nova-compute[74075]:   <target dev="tap9c70564e-8e"/>
Oct 26 09:27:59 user nova-compute[74075]: </interface>
Oct 26 09:27:59 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:27:59 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e5f10-6d7b-483b-923e-c35cca5c20a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:27:59 user nova-compute[74075]: No targets found.
Oct 26 09:27:59 user nova-compute[74075]: iSNS:
Oct 26 09:27:59 user nova-compute[74075]: No targets found.
Oct 26 09:27:59 user nova-compute[74075]: STATIC:
Oct 26 09:27:59 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:27:59 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:59 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:59 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:27:59 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:59 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:59 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:27:59 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:59 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:59 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:27:59 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:59 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:59 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224
Oct 26 09:27:59 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:59 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:59 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:27:59 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:27:59 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:27:59 user nova-compute[74075]: FIRMWARE:
Oct 26 09:27:59 user nova-compute[74075]: No targets found.
Oct 26 09:27:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:27:59 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:27:59 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac050e-f407-4743-9478-c7bb5723d639]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab76bad-e468-48ff-9b12-2fd5393511e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:27:59 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:27:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c279d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd'): ({'sde'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Removing single pathed devices sde {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b37f318-bcaf-4760-b238-a9a29c778acf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[223fa0af-f36a-4d15-8d8d-4353b88127c6]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Flushing IO for device /dev/sde {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[51869f46-4b35-4d20-bbe1-81ca86de1ad3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Start waiting for the detach event from libvirt for device tap9c70564e-8e with device alias net1 for instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594e81d-d69b-49c4-ae70-87d829b2cdd4]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a5fdef-aa41-4cd9-93c5-ec3f54888887]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c09f2d-0709-467b-9f75-f9d91378f77c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]
Oct 26 09:27:59 user nova-compute[74075]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.
Oct 26 09:27:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[681f611c-1d45-437b-ad09-c5f7f51acda7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] <== disconnect_volume: return (383ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-a8eddcd3-5276-41e9-9c43-2e50234f1f1c req-a4fcb8eb-4f4f-4b57-84e4-b9972b9a826e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-unplugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a8eddcd3-5276-41e9-9c43-2e50234f1f1c req-a4fcb8eb-4f4f-4b57-84e4-b9972b9a826e service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a8eddcd3-5276-41e9-9c43-2e50234f1f1c req-a4fcb8eb-4f4f-4b57-84e4-b9972b9a826e service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a8eddcd3-5276-41e9-9c43-2e50234f1f1c req-a4fcb8eb-4f4f-4b57-84e4-b9972b9a826e service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:27:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-a8eddcd3-5276-41e9-9c43-2e50234f1f1c req-a4fcb8eb-4f4f-4b57-84e4-b9972b9a826e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-unplugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:27:59 user nova-compute[74075]: WARNING nova.compute.manager [req-a8eddcd3-5276-41e9-9c43-2e50234f1f1c req-a4fcb8eb-4f4f-4b57-84e4-b9972b9a826e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-unplugged-9c70564e-8e15-4072-92f9-72bd83d016e1 for instance with vm_state active and task_state None.
Oct 26 09:28:00 user nova-compute[74075]: DEBUG nova.objects.instance [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lazy-loading 'flavor' on Instance uuid dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-847c2499-a4c7-4248-9c89-30d326db25d0 tempest-VolumesAssistedSnapshotsTest-337148977 tempest-VolumesAssistedSnapshotsTest-337148977-project-admin] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.548s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCtQISFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0', 'attached_at': '', 'detached_at': '', 'volume_id': '1a3a7498-7bd8-42ca-9704-12123def206d', 'serial'} {{(pid=74075) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 09:28:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] swap_volume: removing Cinder connection for volume 2901dbbf-756a-482c-99f0-a70ea04cffcd {{(pid=74075) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] swap_volume: Updating volume 2901dbbf-756a-482c-99f0-a70ea04cffcd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HCtQISFP", "auth_password": "sz5d9CbjUv1SlX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "1a3a7498-7bd8-42ca-9704-12123def206d"}, "status": "reserved", "instance": "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0", "attached_at": "", "detached_at": "", "volume_id": "1a3a7498-7bd8-42ca-9704-12123def206d", "serial": "1a3a7498-7bd8-42ca-9704-12123def206d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1a3a7498-7bd8-42ca-9704-12123def206d', 'no_device': None, 'attachment_id': 'cdca1c1e-8cf7-4fed-96c3-f582b7e48490'} {{(pid=74075) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-62f414fc-13ea-44c1-a386-430b46ca510a tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 35.899s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-cb2fae9a-5429-4a51-8cc2-af5409c48653 req-4166918a-5bcb-4363-822e-cb018f107f0e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cb2fae9a-5429-4a51-8cc2-af5409c48653 req-4166918a-5bcb-4363-822e-cb018f107f0e service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cb2fae9a-5429-4a51-8cc2-af5409c48653 req-4166918a-5bcb-4363-822e-cb018f107f0e service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cb2fae9a-5429-4a51-8cc2-af5409c48653 req-4166918a-5bcb-4363-822e-cb018f107f0e service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-cb2fae9a-5429-4a51-8cc2-af5409c48653 req-4166918a-5bcb-4363-822e-cb018f107f0e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:01 user nova-compute[74075]: WARNING nova.compute.manager [req-cb2fae9a-5429-4a51-8cc2-af5409c48653 req-4166918a-5bcb-4363-822e-cb018f107f0e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-plugged-9c70564e-8e15-4072-92f9-72bd83d016e1 for instance with vm_state active and task_state None.
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG os_brick.utils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5bef42-ce12-49cc-b7a7-699fa973a2d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2fe58-6bd3-4c51-bb72-3e4bbe16a4ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab233109-4726-4386-bab0-53f0b5967fbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358140b-4aec-4c93-810a-8560520e810f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:28:02 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:28:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e40605-03f9-4d1f-82d3-649dffad2bf5]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:28:02 user nova-compute[74075]: DEBUG os_brick.utils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:02 user nova-compute[74075]: INFO nova.compute.manager [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Swapping volume 1a3a7498-7bd8-42ca-9704-12123def206d for 2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:28:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lazy-loading 'flavor' on Instance uuid 8fde35bc-f050-40fa-8975-b10691739658 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-33eb5803-c6d1-441e-ad59-becae91fb96e tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.833s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.volume.cinder [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Update attachment failed for attachment 24ee1ca0-58a4-453a-9394-f1163b40deae. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5c6e8c9c-fe56-47ae-92c8-6f81d251b500) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5c6e8c9c-fe56-47ae-92c8-6f81d251b500)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Failed to attach f67179c2-9921-46cb-9016-e583b7cc1865 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5c6e8c9c-fe56-47ae-92c8-6f81d251b500)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Traceback (most recent call last):
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     self._do_attach(context, instance, volume, volume_api,
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     self._volume_attach(context, volume, connector, instance,
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     connection_info = volume_api.attachment_update(
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     res = method(self, ctx, *args, **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     with excutils.save_and_reraise_exception():
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     self.force_reraise()
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     raise self.value
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     return method.func(obj, *args, **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     resp = self._update('/attachments/%s' % id, body)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     return self.request(url, method, **kwargs)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25]     raise exceptions.from_response(resp, body)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5c6e8c9c-fe56-47ae-92c8-6f81d251b500)
Oct 26 09:28:09 user nova-compute[74075]: ERROR nova.compute.manager [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] 
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.337s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server [None req-55f46ead-55ba-48fe-989a-ea6cd2728dfb tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5c6e8c9c-fe56-47ae-92c8-6f81d251b500)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5c6e8c9c-fe56-47ae-92c8-6f81d251b500)
Oct 26 09:28:10 user nova-compute[74075]: ERROR oslo_messaging.rpc.server 
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:10 user nova-compute[74075]: INFO nova.compute.manager [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Terminating instance
Oct 26 09:28:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-ff231a95-146b-41a0-a379-5c17f014ee1f req-08df7517-739b-4621-bb75-0cbb24b048d4 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-vif-unplugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ff231a95-146b-41a0-a379-5c17f014ee1f req-08df7517-739b-4621-bb75-0cbb24b048d4 service nova] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ff231a95-146b-41a0-a379-5c17f014ee1f req-08df7517-739b-4621-bb75-0cbb24b048d4 service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ff231a95-146b-41a0-a379-5c17f014ee1f req-08df7517-739b-4621-bb75-0cbb24b048d4 service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-ff231a95-146b-41a0-a379-5c17f014ee1f req-08df7517-739b-4621-bb75-0cbb24b048d4 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] No waiting events found dispatching network-vif-unplugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-ff231a95-146b-41a0-a379-5c17f014ee1f req-08df7517-739b-4621-bb75-0cbb24b048d4 service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-vif-unplugged-410accba-c082-4e57-98ac-02e80c2d76a0 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:11 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Instance destroyed successfully.
Oct 26 09:28:11 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lazy-loading 'resources' on Instance uuid 8fde35bc-f050-40fa-8975-b10691739658 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-731410694',display_name='tempest-AttachSCSIVolumeTestJSON-server-731410694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-731410694',id=6,image_ref='78a3355a-ab91-43b7-9d6a-6084b2c2df2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZwsjpzf5ARmw25TSuktTJtkXpbSGy3et+6NhezKyAKhgUyefN4RIz9B6am5UnbhlirdePWonPprzgFpgtqrQF0kjzyrF7DcySxLf1YVuHJ06qafj1zoLyi5Kutb9v5Jg==',key_name='tempest-keypair-2097979517',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ad3a815bd24e2c97ad00d409dc7847',ramdisk_id='',reservation_id='r-e9od9dfb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78a3355a-ab91-43b7-9d6a-6084b2c2df2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1397659036',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1397659036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5ca8417e704477a68d980ca2725aa8',uuid=8fde35bc-f050-40fa-8975-b10691739658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Converting VIF {"id": "410accba-c082-4e57-98ac-02e80c2d76a0", "address": "fa:16:3e:41:1c:d3", "network": {"id": "b39a45fb-c94d-4b99-bf91-962a190e87ae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2101307809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ad3a815bd24e2c97ad00d409dc7847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410accba-c0", "ovs_interfaceid": "410accba-c082-4e57-98ac-02e80c2d76a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG os_vif [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap410accba-c0, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7758fa74-5763-42ee-8055-d3afa7cb3fac) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:11 user nova-compute[74075]: INFO os_vif [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:1c:d3,bridge_name='br-int',has_traffic_filtering=True,id=410accba-c082-4e57-98ac-02e80c2d76a0,network=Network(b39a45fb-c94d-4b99-bf91-962a190e87ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410accba-c0')
Oct 26 09:28:11 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Deleting instance files /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658_del
Oct 26 09:28:11 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Deletion of /opt/stack/data/nova/instances/8fde35bc-f050-40fa-8975-b10691739658_del complete
Oct 26 09:28:11 user nova-compute[74075]: INFO nova.compute.manager [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 09:28:11 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:28:11 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8fde35bc-f050-40fa-8975-b10691739658] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:12 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Took 0.93 seconds to deallocate network for instance.
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] Acquiring lock "8fde35bc-f050-40fa-8975-b10691739658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] Lock "8fde35bc-f050-40fa-8975-b10691739658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] No waiting events found dispatching network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:12 user nova-compute[74075]: WARNING nova.compute.manager [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received unexpected event network-vif-plugged-410accba-c082-4e57-98ac-02e80c2d76a0 for instance with vm_state deleted and task_state None.
Oct 26 09:28:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-37fcca51-fc7a-432d-bafe-a5e14ada12ca req-de5d14df-76d4-4fd8-b27b-7a084628d91a service nova] [instance: 8fde35bc-f050-40fa-8975-b10691739658] Received event network-vif-deleted-410accba-c082-4e57-98ac-02e80c2d76a0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:12 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Deleted allocations for instance 8fde35bc-f050-40fa-8975-b10691739658
Oct 26 09:28:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2d9afd26-eca4-4181-bd6d-cb4c5c9fb000 tempest-AttachSCSIVolumeTestJSON-1397659036 tempest-AttachSCSIVolumeTestJSON-1397659036-project-member] Lock "8fde35bc-f050-40fa-8975-b10691739658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.411s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-changed-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing instance network info cache due to event network-changed-1096d4b9-0994-4833-9994-7fa46d69e7e1. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:28:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] Acquiring lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:28:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] Acquired lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:28:14 user nova-compute[74075]: DEBUG nova.network.neutron [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Refreshing network info cache for port 1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:28:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updated VIF entry in instance network info cache for port 1096d4b9-0994-4833-9994-7fa46d69e7e1. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:28:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dd0b0e5b-4756-461d-a4fa-09089b83aa85 req-4e5805ce-b637-40d0-833e-d48fdeb586f3 service nova] Releasing lock "refresh_cache-01e34352-139a-446b-a738-f60aae9c02a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:28:16 user nova-compute[74075]: INFO nova.compute.claims [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Claim successful on node user
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "01e34352-139a-446b-a738-f60aae9c02a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:17 user nova-compute[74075]: INFO nova.compute.manager [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Terminating instance
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:28:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.policy [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1003917645d47fa97204a5120eccadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f45c95858d242088d115e4e062f1c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:28:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Creating image(s)
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "/opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "/opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "/opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb94b298-7cb5-4d5e-8e1e-5d9217a93188 req-4f52dbfd-ef2a-458f-8ca8-b4c8ad61dd55 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb94b298-7cb5-4d5e-8e1e-5d9217a93188 req-4f52dbfd-ef2a-458f-8ca8-b4c8ad61dd55 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb94b298-7cb5-4d5e-8e1e-5d9217a93188 req-4f52dbfd-ef2a-458f-8ca8-b4c8ad61dd55 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb94b298-7cb5-4d5e-8e1e-5d9217a93188 req-4f52dbfd-ef2a-458f-8ca8-b4c8ad61dd55 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb94b298-7cb5-4d5e-8e1e-5d9217a93188 req-4f52dbfd-ef2a-458f-8ca8-b4c8ad61dd55 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb94b298-7cb5-4d5e-8e1e-5d9217a93188 req-4f52dbfd-ef2a-458f-8ca8-b4c8ad61dd55 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-24442869-a3a0-46ad-9a1b-7cf44409e79c req-05025a10-e39b-4515-a803-fe8a7bb55fd8 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24442869-a3a0-46ad-9a1b-7cf44409e79c req-05025a10-e39b-4515-a803-fe8a7bb55fd8 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24442869-a3a0-46ad-9a1b-7cf44409e79c req-05025a10-e39b-4515-a803-fe8a7bb55fd8 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24442869-a3a0-46ad-9a1b-7cf44409e79c req-05025a10-e39b-4515-a803-fe8a7bb55fd8 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-24442869-a3a0-46ad-9a1b-7cf44409e79c req-05025a10-e39b-4515-a803-fe8a7bb55fd8 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-24442869-a3a0-46ad-9a1b-7cf44409e79c req-05025a10-e39b-4515-a803-fe8a7bb55fd8 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-9b67671f-15b1-474f-b542-645d686a9f3a for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk 1073741824" returned: 0 in 0.068s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.224s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Cannot resize image /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Ensure instance console log exists: /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-24a80de1-56bf-4e6c-9de6-089603dc099c req-5874f083-57af-4a0f-80dc-a02186ab0121 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24a80de1-56bf-4e6c-9de6-089603dc099c req-5874f083-57af-4a0f-80dc-a02186ab0121 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24a80de1-56bf-4e6c-9de6-089603dc099c req-5874f083-57af-4a0f-80dc-a02186ab0121 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24a80de1-56bf-4e6c-9de6-089603dc099c req-5874f083-57af-4a0f-80dc-a02186ab0121 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-24a80de1-56bf-4e6c-9de6-089603dc099c req-5874f083-57af-4a0f-80dc-a02186ab0121 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-24a80de1-56bf-4e6c-9de6-089603dc099c req-5874f083-57af-4a0f-80dc-a02186ab0121 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Successfully created port: 22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Instance destroyed successfully.
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lazy-loading 'resources' on Instance uuid 01e34352-139a-446b-a738-f60aae9c02a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1096d4b9-09, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2343d558-c352-4ddd-afda-e3677ed6f65b) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:aa:a4,bridge_name='br-int',has_traffic_filtering=True,id=1096d4b9-0994-4833-9994-7fa46d69e7e1,network=Network(18c70c4b-4ecf-422c-a418-f165af266420),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1096d4b9-09')
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b67671f-15, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Waiting for libvirt event about the detach of device tap9c70564e-8e with device alias net1 from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce is timed out.
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:16:65:17"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c70564e-8e"/></interface> {{(pid=74075) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:16:65:17"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c70564e-8e"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 26 09:28:19 user nova-compute[74075]:   <name>instance-00000008</name>
Oct 26 09:28:19 user nova-compute[74075]:   <uuid>8a38837e-a0c6-43c2-af40-ad1db9d651ce</uuid>
Oct 26 09:28:19 user nova-compute[74075]:   <metadata>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:28:19 user nova-compute[74075]:   <nova:package version="0.0.0"/>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:name>tempest-device-tagging-server-1189807003</nova:name>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:creationTime>2023-10-26 09:26:25</nova:creationTime>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:flavor name="m1.tiny">
Oct 26 09:28:19 user nova-compute[74075]:     <nova:memory>512</nova:memory>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:disk>1</nova:disk>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:swap>0</nova:swap>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:vcpus>1</nova:vcpus>
Oct 26 09:28:19 user nova-compute[74075]:   </nova:flavor>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:owner>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:user uuid="f1e51f861aca4648bd3076ac06369d7a">tempest-TaggedAttachmentsTest-1885075461-project-member</nova:user>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:project uuid="a90cafbb4d16495b834e4972d0ff2004">tempest-TaggedAttachmentsTest-1885075461</nova:project>
Oct 26 09:28:19 user nova-compute[74075]:   </nova:owner>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:ports>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:port uuid="7525d4cf-2e19-4d31-8f4c-61c0a6de017e">
Oct 26 09:28:19 user nova-compute[74075]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:28:19 user nova-compute[74075]:     </nova:port>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:port uuid="9c70564e-8e15-4072-92f9-72bd83d016e1">
Oct 26 09:28:19 user nova-compute[74075]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 26 09:28:19 user nova-compute[74075]:     </nova:port>
Oct 26 09:28:19 user nova-compute[74075]:   </nova:ports>
Oct 26 09:28:19 user nova-compute[74075]: </nova:instance>
Oct 26 09:28:19 user nova-compute[74075]:   </metadata>
Oct 26 09:28:19 user nova-compute[74075]:   <memory unit='KiB'>524288</memory>
Oct 26 09:28:19 user nova-compute[74075]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 09:28:19 user nova-compute[74075]:   <vcpu placement='static'>1</vcpu>
Oct 26 09:28:19 user nova-compute[74075]:   <resource>
Oct 26 09:28:19 user nova-compute[74075]:     <partition>/machine</partition>
Oct 26 09:28:19 user nova-compute[74075]:   </resource>
Oct 26 09:28:19 user nova-compute[74075]:   <sysinfo type='smbios'>
Oct 26 09:28:19 user nova-compute[74075]:     <system>
Oct 26 09:28:19 user nova-compute[74075]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 09:28:19 user nova-compute[74075]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 09:28:19 user nova-compute[74075]:       <entry name='version'>0.0.0</entry>
Oct 26 09:28:19 user nova-compute[74075]:       <entry name='serial'>8a38837e-a0c6-43c2-af40-ad1db9d651ce</entry>
Oct 26 09:28:19 user nova-compute[74075]:       <entry name='uuid'>8a38837e-a0c6-43c2-af40-ad1db9d651ce</entry>
Oct 26 09:28:19 user nova-compute[74075]:       <entry name='family'>Virtual Machine</entry>
Oct 26 09:28:19 user nova-compute[74075]:     </system>
Oct 26 09:28:19 user nova-compute[74075]:   </sysinfo>
Oct 26 09:28:19 user nova-compute[74075]:   <os>
Oct 26 09:28:19 user nova-compute[74075]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 09:28:19 user nova-compute[74075]:     <boot dev='hd'/>
Oct 26 09:28:19 user nova-compute[74075]:     <smbios mode='sysinfo'/>
Oct 26 09:28:19 user nova-compute[74075]:   </os>
Oct 26 09:28:19 user nova-compute[74075]:   <features>
Oct 26 09:28:19 user nova-compute[74075]:     <acpi/>
Oct 26 09:28:19 user nova-compute[74075]:     <apic/>
Oct 26 09:28:19 user nova-compute[74075]:     <vmcoreinfo state='on'/>
Oct 26 09:28:19 user nova-compute[74075]:   </features>
Oct 26 09:28:19 user nova-compute[74075]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 09:28:19 user nova-compute[74075]:     <model fallback='forbid'>Nehalem</model>
Oct 26 09:28:19 user nova-compute[74075]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 09:28:19 user nova-compute[74075]:     <feature policy='require' name='vme'/>
Oct 26 09:28:19 user nova-compute[74075]:     <feature policy='require' name='x2apic'/>
Oct 26 09:28:19 user nova-compute[74075]:     <feature policy='require' name='hypervisor'/>
Oct 26 09:28:19 user nova-compute[74075]:   </cpu>
Oct 26 09:28:19 user nova-compute[74075]:   <clock offset='utc'>
Oct 26 09:28:19 user nova-compute[74075]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 09:28:19 user nova-compute[74075]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 09:28:19 user nova-compute[74075]:     <timer name='hpet' present='no'/>
Oct 26 09:28:19 user nova-compute[74075]:   </clock>
Oct 26 09:28:19 user nova-compute[74075]:   <on_poweroff>destroy</on_poweroff>
Oct 26 09:28:19 user nova-compute[74075]:   <on_reboot>restart</on_reboot>
Oct 26 09:28:19 user nova-compute[74075]:   <on_crash>destroy</on_crash>
Oct 26 09:28:19 user nova-compute[74075]:   <devices>
Oct 26 09:28:19 user nova-compute[74075]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 09:28:19 user nova-compute[74075]:     <disk type='file' device='disk'>
Oct 26 09:28:19 user nova-compute[74075]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 09:28:19 user nova-compute[74075]:       <source file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk' index='2'/>
Oct 26 09:28:19 user nova-compute[74075]:       <backingStore type='file' index='3'>
Oct 26 09:28:19 user nova-compute[74075]:         <format type='raw'/>
Oct 26 09:28:19 user nova-compute[74075]:         <source file='/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f'/>
Oct 26 09:28:19 user nova-compute[74075]:         <backingStore/>
Oct 26 09:28:19 user nova-compute[74075]:       </backingStore>
Oct 26 09:28:19 user nova-compute[74075]:       <target dev='vda' bus='virtio'/>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='virtio-disk0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </disk>
Oct 26 09:28:19 user nova-compute[74075]:     <disk type='file' device='cdrom'>
Oct 26 09:28:19 user nova-compute[74075]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 09:28:19 user nova-compute[74075]:       <source file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk.config' index='1'/>
Oct 26 09:28:19 user nova-compute[74075]:       <backingStore/>
Oct 26 09:28:19 user nova-compute[74075]:       <target dev='hda' bus='ide'/>
Oct 26 09:28:19 user nova-compute[74075]:       <readonly/>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='ide0-0-0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </disk>
Oct 26 09:28:19 user nova-compute[74075]:     <controller type='usb' index='0' model='none'>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='usb'/>
Oct 26 09:28:19 user nova-compute[74075]:     </controller>
Oct 26 09:28:19 user nova-compute[74075]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='pci.0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </controller>
Oct 26 09:28:19 user nova-compute[74075]:     <controller type='ide' index='0'>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='ide'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 09:28:19 user nova-compute[74075]:     </controller>
Oct 26 09:28:19 user nova-compute[74075]:     <interface type='ethernet'>
Oct 26 09:28:19 user nova-compute[74075]:       <mac address='fa:16:3e:a2:4b:20'/>
Oct 26 09:28:19 user nova-compute[74075]:       <target dev='tap7525d4cf-2e'/>
Oct 26 09:28:19 user nova-compute[74075]:       <model type='virtio'/>
Oct 26 09:28:19 user nova-compute[74075]:       <mtu size='1442'/>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='net0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </interface>
Oct 26 09:28:19 user nova-compute[74075]:     <serial type='pty'>
Oct 26 09:28:19 user nova-compute[74075]:       <source path='/dev/pts/7'/>
Oct 26 09:28:19 user nova-compute[74075]:       <log file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/console.log' append='off'/>
Oct 26 09:28:19 user nova-compute[74075]:       <target type='isa-serial' port='0'>
Oct 26 09:28:19 user nova-compute[74075]:         <model name='isa-serial'/>
Oct 26 09:28:19 user nova-compute[74075]:       </target>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='serial0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </serial>
Oct 26 09:28:19 user nova-compute[74075]:     <console type='pty' tty='/dev/pts/7'>
Oct 26 09:28:19 user nova-compute[74075]:       <source path='/dev/pts/7'/>
Oct 26 09:28:19 user nova-compute[74075]:       <log file='/opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/console.log' append='off'/>
Oct 26 09:28:19 user nova-compute[74075]:       <target type='serial' port='0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='serial0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </console>
Oct 26 09:28:19 user nova-compute[74075]:     <input type='mouse' bus='ps2'>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='input0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </input>
Oct 26 09:28:19 user nova-compute[74075]:     <input type='keyboard' bus='ps2'>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='input1'/>
Oct 26 09:28:19 user nova-compute[74075]:     </input>
Oct 26 09:28:19 user nova-compute[74075]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 26 09:28:19 user nova-compute[74075]:       <listen type='address' address='0.0.0.0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </graphics>
Oct 26 09:28:19 user nova-compute[74075]:     <audio id='1' type='none'/>
Oct 26 09:28:19 user nova-compute[74075]:     <video>
Oct 26 09:28:19 user nova-compute[74075]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='video0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </video>
Oct 26 09:28:19 user nova-compute[74075]:     <memballoon model='virtio'>
Oct 26 09:28:19 user nova-compute[74075]:       <stats period='10'/>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='balloon0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </memballoon>
Oct 26 09:28:19 user nova-compute[74075]:     <rng model='virtio'>
Oct 26 09:28:19 user nova-compute[74075]:       <backend model='random'>/dev/urandom</backend>
Oct 26 09:28:19 user nova-compute[74075]:       <alias name='rng0'/>
Oct 26 09:28:19 user nova-compute[74075]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 09:28:19 user nova-compute[74075]:     </rng>
Oct 26 09:28:19 user nova-compute[74075]:   </devices>
Oct 26 09:28:19 user nova-compute[74075]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 09:28:19 user nova-compute[74075]:     <label>libvirt-8a38837e-a0c6-43c2-af40-ad1db9d651ce</label>
Oct 26 09:28:19 user nova-compute[74075]:     <imagelabel>libvirt-8a38837e-a0c6-43c2-af40-ad1db9d651ce</imagelabel>
Oct 26 09:28:19 user nova-compute[74075]:   </seclabel>
Oct 26 09:28:19 user nova-compute[74075]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 09:28:19 user nova-compute[74075]:     <label>+64055:+108</label>
Oct 26 09:28:19 user nova-compute[74075]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 09:28:19 user nova-compute[74075]:   </seclabel>
Oct 26 09:28:19 user nova-compute[74075]: </domain>
Oct 26 09:28:19 user nova-compute[74075]:  {{(pid=74075) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 09:28:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully detached device tap9c70564e-8e from instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce from the live domain config.
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "9c70564e-8e15-4072-92f9-72bd83d016e1", "address": "fa:16:3e:16:65:17", "network": {"id": "443f4910-39cc-4187-8279-5ffbe76987d4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1986689787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c70564e-8e", "ovs_interfaceid": "9c70564e-8e15-4072-92f9-72bd83d016e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG os_vif [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c70564e-8e, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Successfully updated port: 22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fc3a432-e5f8-48bc-804a-6f8d0a73005e) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "refresh_cache-7635aa37-fdd4-4443-91e7-81743eaf3672" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquired lock "refresh_cache-7635aa37-fdd4-4443-91e7-81743eaf3672" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55c2ab36-a738-42f4-a33d-25e894287901) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:b3:af,bridge_name='br-int',has_traffic_filtering=True,id=9b67671f-15b1-474f-b542-645d686a9f3a,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b67671f-15')
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66c963d1-23, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: INFO os_vif [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:65:17,bridge_name='br-int',has_traffic_filtering=True,id=9c70564e-8e15-4072-92f9-72bd83d016e1,network=Network(443f4910-39cc-4187-8279-5ffbe76987d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c70564e-8e')
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:28:19 user nova-compute[74075]:   <nova:package version="0.0.0"/>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:name>tempest-device-tagging-server-1189807003</nova:name>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:creationTime>2023-10-26 09:28:19</nova:creationTime>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:flavor name="m1.tiny">
Oct 26 09:28:19 user nova-compute[74075]:     <nova:memory>512</nova:memory>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:disk>1</nova:disk>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:swap>0</nova:swap>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:vcpus>1</nova:vcpus>
Oct 26 09:28:19 user nova-compute[74075]:   </nova:flavor>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:owner>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:user uuid="f1e51f861aca4648bd3076ac06369d7a">tempest-TaggedAttachmentsTest-1885075461-project-member</nova:user>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:project uuid="a90cafbb4d16495b834e4972d0ff2004">tempest-TaggedAttachmentsTest-1885075461</nova:project>
Oct 26 09:28:19 user nova-compute[74075]:   </nova:owner>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:28:19 user nova-compute[74075]:   <nova:ports>
Oct 26 09:28:19 user nova-compute[74075]:     <nova:port uuid="7525d4cf-2e19-4d31-8f4c-61c0a6de017e">
Oct 26 09:28:19 user nova-compute[74075]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:28:19 user nova-compute[74075]:     </nova:port>
Oct 26 09:28:19 user nova-compute[74075]:   </nova:ports>
Oct 26 09:28:19 user nova-compute[74075]: </nova:instance>
Oct 26 09:28:19 user nova-compute[74075]:  {{(pid=74075) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5085fbd0-1a72-4224-ae81-fa29090f2e79) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:19 user nova-compute[74075]: WARNING nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-1096d4b9-0994-4833-9994-7fa46d69e7e1 for instance with vm_state active and task_state deleting.
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-66c963d1-23e3-461b-a474-d735dc246f4f for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:19 user nova-compute[74075]: WARNING nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-66c963d1-23e3-461b-a474-d735dc246f4f for instance with vm_state active and task_state deleting.
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:19 user nova-compute[74075]: WARNING nova.compute.manager [req-c791cd94-6b8f-47ee-9d80-0be1870a8c6d req-c600aab4-b048-4fec-af1c-0a8e63e15030 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 for instance with vm_state active and task_state deleting.
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d0:ae,bridge_name='br-int',has_traffic_filtering=True,id=66c963d1-23e3-461b-a474-d735dc246f4f,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66c963d1-23')
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "address": "fa:16:3e:61:ab:0b", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4c2a14-1e", "ovs_interfaceid": "bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd4c2a14-1e, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1935330-8b92-4c42-9f0f-59a5991b722d) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4c2a14-1e')
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c47a0fa-61, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bef3c4f-025c-4f2f-a1f5-e533c45389d6) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Updating instance_info_cache with network_info: [{"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Releasing lock "refresh_cache-7635aa37-fdd4-4443-91e7-81743eaf3672" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Instance network_info: |[{"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Start _get_guest_xml network_info=[{"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:28:20 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:97:5f,bridge_name='br-int',has_traffic_filtering=True,id=5c47a0fa-616d-4b3c-99f5-421ac07d4259,network=Network(a52a0c82-b467-4def-b2e0-12e6da202611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c47a0fa-61')
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeacd9076-ea, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:28:20 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d83c1fd1-59f0-44b2-9b7e-477004385d1d) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1887157309',display_name='tempest-VolumesAdminNegativeTest-server-1887157309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1887157309',id=11,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f45c95858d242088d115e4e062f1c55',ramdisk_id='',reservation_id='r-l0i0nmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1450530067',owner_user_name='tempest-VolumesAdminNegativeTest-1450530067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:28:18Z,user_data=None,user_id='c1003917645d47fa97204a5120eccadf',uuid=7635aa37-fdd4-4443-91e7-81743eaf3672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converting VIF {"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'pci_devices' on Instance uuid 7635aa37-fdd4-4443-91e7-81743eaf3672 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e3:7e,bridge_name='br-int',has_traffic_filtering=True,id=eacd9076-eae3-492a-8b1a-ee98fe10bc17,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacd9076-ea')
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1696157973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1696157973',id=10,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXExEoVLQWmnrQbZ62QDks8Nd8gE0K56Mn1nTJlYV4ybnWHWm7t5LW7lPBldypcL4jOnI2j4HIEOny539uI3Grpgj2m61qLC3VFL62vA//LpWzW7Ri9zAP+YC4zJ3dMfA==',key_name='tempest-keypair-1338500872',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfd8436061f42e88cc89505087c2dab',ramdisk_id='',reservation_id='r-bekrr0y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1232865979',owner_user_name='tempest-TaggedBootDevicesTest_v242-1232865979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c72261377aed422dab1948357f7a035e',uuid=01e34352-139a-446b-a738-f60aae9c02a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converting VIF {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-9b67671f-15b1-474f-b542-645d686a9f3a for instance with vm_state active and task_state deleting.
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-5c47a0fa-616d-4b3c-99f5-421ac07d4259 for instance with vm_state active and task_state deleting.
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-unplugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-unplugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING nova.compute.manager [req-2d9cee7a-9c9c-4c01-a8ba-be80bec4fa1b req-dde6da59-cd66-4ea4-abdf-22d80680f2dc service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-eacd9076-eae3-492a-8b1a-ee98fe10bc17 for instance with vm_state active and task_state deleting.
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38db9e7d-1a, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:28:20 user nova-compute[74075]:   <uuid>7635aa37-fdd4-4443-91e7-81743eaf3672</uuid>
Oct 26 09:28:20 user nova-compute[74075]:   <name>instance-0000000b</name>
Oct 26 09:28:20 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:28:20 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:28:20 user nova-compute[74075]:   <metadata>
Oct 26 09:28:20 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:28:20 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:28:20 user nova-compute[74075]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1887157309</nova:name>
Oct 26 09:28:20 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:28:20</nova:creationTime>
Oct 26 09:28:20 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:28:20 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:28:20 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:28:20 user nova-compute[74075]:       <nova:owner>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:user uuid="c1003917645d47fa97204a5120eccadf">tempest-VolumesAdminNegativeTest-1450530067-project-member</nova:user>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:project uuid="9f45c95858d242088d115e4e062f1c55">tempest-VolumesAdminNegativeTest-1450530067</nova:project>
Oct 26 09:28:20 user nova-compute[74075]:       </nova:owner>
Oct 26 09:28:20 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:28:20 user nova-compute[74075]:       <nova:ports>
Oct 26 09:28:20 user nova-compute[74075]:         <nova:port uuid="22717075-d033-49be-87ac-28d7e741a229">
Oct 26 09:28:20 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 09:28:20 user nova-compute[74075]:         </nova:port>
Oct 26 09:28:20 user nova-compute[74075]:       </nova:ports>
Oct 26 09:28:20 user nova-compute[74075]:     </nova:instance>
Oct 26 09:28:20 user nova-compute[74075]:   </metadata>
Oct 26 09:28:20 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:28:20 user nova-compute[74075]:     <system>
Oct 26 09:28:20 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:28:20 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:28:20 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:28:20 user nova-compute[74075]:       <entry name="serial">7635aa37-fdd4-4443-91e7-81743eaf3672</entry>
Oct 26 09:28:20 user nova-compute[74075]:       <entry name="uuid">7635aa37-fdd4-4443-91e7-81743eaf3672</entry>
Oct 26 09:28:20 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:28:20 user nova-compute[74075]:     </system>
Oct 26 09:28:20 user nova-compute[74075]:   </sysinfo>
Oct 26 09:28:20 user nova-compute[74075]:   <os>
Oct 26 09:28:20 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:28:20 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:28:20 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:28:20 user nova-compute[74075]:   </os>
Oct 26 09:28:20 user nova-compute[74075]:   <features>
Oct 26 09:28:20 user nova-compute[74075]:     <acpi/>
Oct 26 09:28:20 user nova-compute[74075]:     <apic/>
Oct 26 09:28:20 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:28:20 user nova-compute[74075]:   </features>
Oct 26 09:28:20 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:28:20 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:28:20 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:28:20 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:28:20 user nova-compute[74075]:   </clock>
Oct 26 09:28:20 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:28:20 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:28:20 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:28:20 user nova-compute[74075]:   </cpu>
Oct 26 09:28:20 user nova-compute[74075]:   <devices>
Oct 26 09:28:20 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:28:20 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:28:20 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk"/>
Oct 26 09:28:20 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:28:20 user nova-compute[74075]:     </disk>
Oct 26 09:28:20 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:28:20 user nova-compute[74075]:       <mac address="fa:16:3e:a4:0a:ca"/>
Oct 26 09:28:20 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:28:20 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:28:20 user nova-compute[74075]:       <target dev="tap22717075-d0"/>
Oct 26 09:28:20 user nova-compute[74075]:     </interface>
Oct 26 09:28:20 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:28:20 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/console.log" append="off"/>
Oct 26 09:28:20 user nova-compute[74075]:     </serial>
Oct 26 09:28:20 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:28:20 user nova-compute[74075]:     <video>
Oct 26 09:28:20 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:28:20 user nova-compute[74075]:     </video>
Oct 26 09:28:20 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:28:20 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:28:20 user nova-compute[74075]:     </rng>
Oct 26 09:28:20 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:28:20 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:28:20 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:28:20 user nova-compute[74075]:     </memballoon>
Oct 26 09:28:20 user nova-compute[74075]:   </devices>
Oct 26 09:28:20 user nova-compute[74075]: </domain>
Oct 26 09:28:20 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1887157309',display_name='tempest-VolumesAdminNegativeTest-server-1887157309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1887157309',id=11,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f45c95858d242088d115e4e062f1c55',ramdisk_id='',reservation_id='r-l0i0nmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1450530067',owner_user_name='tempest-VolumesAdminNegativeTest-1450530067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:28:18Z,user_data=None,user_id='c1003917645d47fa97204a5120eccadf',uuid=7635aa37-fdd4-4443-91e7-81743eaf3672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converting VIF {"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_vif [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ac2de6b-48bd-4fbc-830a-fd928a86fa47) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de01ce08-0a8a-55f0-aa98-26c465380ce1', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: INFO os_vif [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f2:ba,bridge_name='br-int',has_traffic_filtering=True,id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f,network=Network(fd6dc47d-00eb-4dbb-b909-d61dfd6261d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38db9e7d-1a')
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdwMZCsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22717075-d0, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22717075-d0, col_values=(('qos', UUID('a2d9ab3e-93e4-411f-8dc5-7231b8375213')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22717075-d0, col_values=(('external_ids', {'iface-id': '22717075-d033-49be-87ac-28d7e741a229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:0a:ca', 'vm-uuid': '7635aa37-fdd4-4443-91e7-81743eaf3672'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dda93a-c0b0-406f-a55a-8aa31cfe890a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]: iSNS:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]: STATIC:
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: FIRMWARE:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:28:20 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:28:20 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:20 user nova-compute[74075]: INFO os_vif [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0')
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc91d7d-0063-4f86-9c45-6f8887280769]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee3f885-7710-42ee-8803-0195e349e196]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c278310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224'): ({'sdf'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Removing single pathed devices sdf {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f1371d-4b40-4386-9e85-427875eedcd7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] No VIF found with MAC fa:16:3e:a4:0a:ca, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906fe1f-8f11-406f-88f1-249414d35284]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Flushing IO for device /dev/sdf {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb2d3d4-1129-4b93-8650-03450a77330a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquired lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.neutron [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b9a76-67ed-4697-8be1-883b7e1a5802]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[717a7bb8-3873-42e0-bf47-ba0815ed5d16]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[54634fe4-6dd8-49a0-9e53-2ecd70ba74ca]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260]
Oct 26 09:28:20 user nova-compute[74075]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:243d8798-0c8d-481a-8a9d-20bb69657224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d4e89-20a7-47e9-b641-40f234aabfbc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== disconnect_volume: return (341ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUMhJzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dde08a-1d88-4801-a2f2-3df9fc1c4934]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]: iSNS:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]: STATIC:
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: FIRMWARE:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:28:20 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:28:20 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc9a22-8c69-400b-895b-56ffab6787cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f368d-0e39-4a1b-8492-05f65f94e50c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f466418e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0'): ({'sdg'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Removing single pathed devices sdg {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] Acquiring lock "01e34352-139a-446b-a738-f60aae9c02a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] Lock "01e34352-139a-446b-a738-f60aae9c02a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] No waiting events found dispatching network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING nova.compute.manager [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received unexpected event network-vif-plugged-38db9e7d-1a60-453c-a7fc-90b00e6ae62f for instance with vm_state active and task_state deleting.
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-changed-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Refreshing instance network info cache due to event network-changed-22717075-d033-49be-87ac-28d7e741a229. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] Acquiring lock "refresh_cache-7635aa37-fdd4-4443-91e7-81743eaf3672" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] Acquired lock "refresh_cache-7635aa37-fdd4-4443-91e7-81743eaf3672" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Refreshing network info cache for port 22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021bb12-c391-41ed-a4b1-7b762c5bbb6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[94827ca0-deff-420d-baee-7713af2747f2]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Flushing IO for device /dev/sdg {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1dcf57-f58e-433e-b3ae-784401171b29]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ce66f-5f1e-405c-8ad9-605f58dcee94]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[33033cb8-02f8-44c5-aa34-157447edd13e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: INFO nova.network.neutron [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Port 9c70564e-8e15-4072-92f9-72bd83d016e1 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.network.neutron [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [{"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Releasing lock "refresh_cache-8a38837e-a0c6-43c2-af40-ad1db9d651ce" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6abecd-c351-46f0-9190-88de56c0739b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260]
Oct 26 09:28:20 user nova-compute[74075]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-304461bd-db8b-4fa6-8b1b-090eab8b6e27 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "interface-8a38837e-a0c6-43c2-af40-ad1db9d651ce-9c70564e-8e15-4072-92f9-72bd83d016e1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.847s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf27916-77c3-49ba-87a3-45eeb7d5d2b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd6ac3-53d1-43da-828a-9fe3e229ff07]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== disconnect_volume: return (376ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZtymkhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:20 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8631f15-81a0-4f90-af89-1cce259db811]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]: iSNS:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]: STATIC:
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:28:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:20 user nova-compute[74075]: FIRMWARE:
Oct 26 09:28:20 user nova-compute[74075]: No targets found.
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:28:20 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:28:20 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7760fb-a175-41df-98b9-94a08620c3dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ea6f1-6134-494c-8d7c-bec441ef377f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:20 user nova-compute[74075]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 (non-flash)
Oct 26 09:28:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c282200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:28:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[40829ea8-4d9a-4b36-a79e-4bd4a6cd31c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Updated VIF entry in instance network info cache for port 22717075-d033-49be-87ac-28d7e741a229. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Updating instance_info_cache with network_info: [{"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c2220-3f0c-45a2-a435-62e2b8fd97a5]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a5404cd-e009-47db-9fb9-464ba2a53099 req-a24b413d-98de-4c43-abc0-adf5e1c0556b service nova] Releasing lock "refresh_cache-7635aa37-fdd4-4443-91e7-81743eaf3672" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e59a626-f7c8-4aee-a9c0-a6bd459f9e92]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e55b25-03bf-4837-9cfe-5e6076886cff]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c650680e-855b-41b0-a767-ce1520107a22]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ede70-6e3a-4517-acfa-d701308638bb]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260]
Oct 26 09:28:21 user nova-compute[74075]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:21 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ae8cdf-baf1-40e6-ba10-3eef0b6c96b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c2285-9165-41d9-8c1a-9aec667abd2f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] <== disconnect_volume: return (332ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:28:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Deleting instance files /opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7_del
Oct 26 09:28:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Deletion of /opt/stack/data/nova/instances/01e34352-139a-446b-a738-f60aae9c02a7_del complete
Oct 26 09:28:21 user nova-compute[74075]: INFO nova.compute.manager [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Took 3.97 seconds to destroy the instance on the hypervisor.
Oct 26 09:28:21 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-768dcd4b-bc22-40bd-9866-e49678f70730 req-f755d01b-dcdf-4089-b572-ebab81c97d8c service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-deleted-9c70564e-8e15-4072-92f9-72bd83d016e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] No waiting events found dispatching network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:22 user nova-compute[74075]: WARNING nova.compute.manager [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received unexpected event network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 for instance with vm_state building and task_state spawning.
Oct 26 09:28:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] No waiting events found dispatching network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:22 user nova-compute[74075]: WARNING nova.compute.manager [req-1a958eda-ed65-4024-9e8a-0830899bfc11 req-962ff3e1-e06d-41e1-b1cb-40bea4cd0a3a service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received unexpected event network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 for instance with vm_state building and task_state spawning.
Oct 26 09:28:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:28:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:28:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Instance spawned successfully.
Oct 26 09:28:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:28:24 user nova-compute[74075]: INFO nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Took 6.76 seconds to spawn the instance on the hypervisor.
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:28:24 user nova-compute[74075]: INFO nova.compute.manager [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Took 7.60 seconds to build instance.
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4191780f-82a3-4dcc-afcf-18425ed519a5 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.714s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-deleted-bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:24 user nova-compute[74075]: INFO nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Neutron deleted interface bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2; detaching it from the instance and deleting it from the info cache
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "address": "fa:16:3e:91:e3:7e", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacd9076-ea", "ovs_interfaceid": "eacd9076-eae3-492a-8b1a-ee98fe10bc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Detach interface failed, port_id=bd4c2a14-1e55-4eaf-ba59-1aeb47579ed2, reason: Instance 01e34352-139a-446b-a738-f60aae9c02a7 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-deleted-eacd9076-eae3-492a-8b1a-ee98fe10bc17 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:24 user nova-compute[74075]: INFO nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Neutron deleted interface eacd9076-eae3-492a-8b1a-ee98fe10bc17; detaching it from the instance and deleting it from the info cache
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "address": "fa:16:3e:0c:aa:a4", "network": {"id": "18c70c4b-4ecf-422c-a418-f165af266420", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1262136354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1096d4b9-09", "ovs_interfaceid": "1096d4b9-0994-4833-9994-7fa46d69e7e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Detach interface failed, port_id=eacd9076-eae3-492a-8b1a-ee98fe10bc17, reason: Instance 01e34352-139a-446b-a738-f60aae9c02a7 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-deleted-1096d4b9-0994-4833-9994-7fa46d69e7e1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:24 user nova-compute[74075]: INFO nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Neutron deleted interface 1096d4b9-0994-4833-9994-7fa46d69e7e1; detaching it from the instance and deleting it from the info cache
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "address": "fa:16:3e:09:f2:ba", "network": {"id": "fd6dc47d-00eb-4dbb-b909-d61dfd6261d3", "bridge": "br-int", "label": "tempest-device-tagging-net2-366582032", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38db9e7d-1a", "ovs_interfaceid": "38db9e7d-1a60-453c-a7fc-90b00e6ae62f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2901dbbf-756a-482c-99f0-a70ea04cffcd', 'serial': '2901dbbf-756a-482c-99f0-a70ea04cffcd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCtQISFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '1a3a7498-7bd8-42ca-9704-12123def206d'}, 'status': 'reserved', 'instance': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0', 'attached_at': '', 'detached_at': '', 'volume_id': '1a3a7498-7bd8-42ca-9704-12123def206d', 'serial'} {{(pid=74075) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Detach interface failed, port_id=1096d4b9-0994-4833-9994-7fa46d69e7e1, reason: Instance 01e34352-139a-446b-a738-f60aae9c02a7 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-deleted-38db9e7d-1a60-453c-a7fc-90b00e6ae62f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:24 user nova-compute[74075]: INFO nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Neutron deleted interface 38db9e7d-1a60-453c-a7fc-90b00e6ae62f; detaching it from the instance and deleting it from the info cache
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [{"id": "9b67671f-15b1-474f-b542-645d686a9f3a", "address": "fa:16:3e:a5:b3:af", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b67671f-15", "ovs_interfaceid": "9b67671f-15b1-474f-b542-645d686a9f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66c963d1-23e3-461b-a474-d735dc246f4f", "address": "fa:16:3e:6a:d0:ae", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c963d1-23", "ovs_interfaceid": "66c963d1-23e3-461b-a474-d735dc246f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "address": "fa:16:3e:63:97:5f", "network": {"id": "a52a0c82-b467-4def-b2e0-12e6da202611", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576767251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8bfd8436061f42e88cc89505087c2dab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c47a0fa-61", "ovs_interfaceid": "5c47a0fa-616d-4b3c-99f5-421ac07d4259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:24 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:24 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:24 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-8bb76b6a-d5c3-482b-b283-1256cdd3ffca req-c419eb32-3e1d-4ced-ab47-8ea87e250534 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Detach interface failed, port_id=38db9e7d-1a60-453c-a7fc-90b00e6ae62f, reason: Instance 01e34352-139a-446b-a738-f60aae9c02a7 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b877a4-968f-41ad-b70f-d7369c0cfc41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:28:24 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc33fb4-a136-48da-95e1-b7e14467ed0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd] added
Oct 26 09:28:24 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a892d4-a635-4884-80f1-8c102a8c20d5]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d599d4-6b55-4e63-9015-2578b7a9a97c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfYGwAqc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfYGwAqc" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b261b2b-9bca-4861-ba8f-007f83dfa424]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfYGwAqc'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:25 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Took 3.69 seconds to deallocate network for instance.
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[865adb12-6883-44aa-a715-8d8583c42e3d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e0fa8a-95ef-492d-a1ac-9e7eacabd723]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0e82c-a1b8-4e3a-9d61-ee190764d62f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]
Oct 26 09:28:25 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b22575-e7ae-46ea-b574-7bb7addbdf7d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748ef97-4277-4fd9-b4f5-46593578a2f6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:25 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:25 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e5ec8-e6be-471d-9685-37e88302fe13]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:28:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26461333333376336', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461333333376336', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lazy-loading 'flavor' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a5bbf72-0124-4709-a83f-953693031983 req-b591e957-c14f-4606-8823-7b888f2389b3 service nova] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Received event network-vif-deleted-5c47a0fa-616d-4b3c-99f5-421ac07d4259 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 111149056 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 245366784 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 371195904 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:29 user nova-compute[74075]: INFO nova.compute.manager [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] [instance: 01e34352-139a-446b-a738-f60aae9c02a7] Took 4.20 seconds to detach 3 volumes for instance.
Oct 26 09:28:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 569376768 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 742391808 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:29 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:28:29 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:28:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:30 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Deleted allocations for instance 01e34352-139a-446b-a738-f60aae9c02a7
Oct 26 09:28:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3fc71ea-9684-4389-868f-3e9df5847367 tempest-TaggedBootDevicesTest_v242-1232865979 tempest-TaggedBootDevicesTest_v242-1232865979-project-member] Lock "01e34352-139a-446b-a738-f60aae9c02a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.832s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 889192448 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 1034944512 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCtQISFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '1a3a7498-7bd8-42ca-9704-12123def206d'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:31 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ec579-70f6-4aa4-a83d-c8b49e5ba1a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:28:31 user nova-compute[74075]: No targets found.
Oct 26 09:28:31 user nova-compute[74075]: iSNS:
Oct 26 09:28:31 user nova-compute[74075]: No targets found.
Oct 26 09:28:31 user nova-compute[74075]: STATIC:
Oct 26 09:28:31 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:28:31 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:31 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:31 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:28:31 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:31 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:31 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d
Oct 26 09:28:31 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:31 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:31 user nova-compute[74075]: FIRMWARE:
Oct 26 09:28:31 user nova-compute[74075]: No targets found.
Oct 26 09:28:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:28:31 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:28:31 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31183ac-8106-4fd5-80a0-d2e3c1f63c60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[babbfe47-1929-4dea-be57-3d91693ad2e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:31 user nova-compute[74075]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:31 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d (non-flash)
Oct 26 09:28:31 user nova-compute[74075]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:31 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c280a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84df92a-bf4e-454e-81cd-afa87e9cf6dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d5e4e-63fd-432a-a967-e6bb11979d39]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e7ed3-c53b-4adc-a7bc-8a91b16d06db]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd8bbb-a981-4d34-91b4-946168bcb9d4]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a1f82b-67e7-4956-a2cd-bd6648375c01]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b20aa6-1d37-48c5-aba9-1060b8c481a9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260]
Oct 26 09:28:31 user nova-compute[74075]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3a7498-7bd8-42ca-9704-12123def206d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71e25ae-0ca0-4690-b2a7-d9a40e22553f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] <== disconnect_volume: return (306ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '771ed6ed-15e1-40a8-8ad7-f11dd424f4a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2901dbbf-756a-482c-99f0-a70ea04cffcd', 'serial'} {{(pid=74075) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 09:28:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] swap_volume: removing Cinder connection for volume 1a3a7498-7bd8-42ca-9704-12123def206d {{(pid=74075) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 09:28:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'info_cache' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:40 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance destroyed successfully.
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'resources' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbf845ec-94, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09f3ea2f-bf32-415d-95c7-b680adb18927) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:41 user nova-compute[74075]: INFO os_vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94')
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a3ae33-c67c-4cb3-beea-89051aac1f88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:28:41 user nova-compute[74075]: No targets found.
Oct 26 09:28:41 user nova-compute[74075]: iSNS:
Oct 26 09:28:41 user nova-compute[74075]: No targets found.
Oct 26 09:28:41 user nova-compute[74075]: STATIC:
Oct 26 09:28:41 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:28:41 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:41 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:41 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:28:41 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:28:41 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:28:41 user nova-compute[74075]: FIRMWARE:
Oct 26 09:28:41 user nova-compute[74075]: No targets found.
Oct 26 09:28:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:28:41 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:28:41 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e551feaa-92cd-46c3-ab38-f3535f6af8ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3fb8a1-d273-40c9-97bb-b45d21014160]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:41 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:41 user nova-compute[74075]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e21aff-d922-4f1b-8d08-a1ad6410507b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01b55e1-cf5c-484e-a24d-204de0dfd746]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60deed4-ccbc-4588-a84b-e5077a118152]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[717550fb-2d40-4b53-8dd2-c34777536302]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82b879-f7f3-4e3d-85f5-ae4a0a3e957b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb58015-a2d5-409f-b911-196014167ef4]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]
Oct 26 09:28:41 user nova-compute[74075]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af703b-b562-419e-8063-64e1e6e1ded3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== disconnect_volume: return (309ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start _get_guest_xml network_info=[{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'adf45f8e-3913-4663-8f15-e4d1179c00f6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e4baa273-79c9-408c-9c41-17e202582246', 'attached_at': '', 'detached_at': '', 'volume_id': '8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'serial': '8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'numa_topology' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:28:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:28:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:28:41 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b589c-f361-4f61-94f9-6d639f6d4ef0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:28:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[83559f99-df10-4748-98b9-51424eaee30a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d] added
Oct 26 09:28:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53192e9e-200e-45d3-8963-01b5366e7495]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a7a92-a480-4e35-a91a-b66af6be8947]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHDQZzob {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHDQZzob" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a24455a-4c88-47ab-a535-f64fa1e6f10f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KHDQZzob'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e2dbc2-2632-44b3-ba1a-ebf53f14f7ce]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[be709a58-df85-41e2-8e3a-69a743a01a9e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:42 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:42 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8c1d0-46ac-4225-bbfb-e2a481265399]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]
Oct 26 09:28:42 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.
Oct 26 09:28:42 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da4d52-65c6-4492-aee0-23d16d3f6fa3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3461f-dd3d-41d7-8893-728124e264c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:42 user nova-compute[74075]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:42 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:28:42 user nova-compute[74075]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:28:42 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd5d9b-b3c4-4fde-8320-56d19611202b]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:42 user nova-compute[74075]: INFO nova.compute.manager [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Terminating instance
Oct 26 09:28:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] swap_volume: Updating volume 1a3a7498-7bd8-42ca-9704-12123def206d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TfYGwAqc", "auth_password": "ujiFUGcD82IrtE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "2901dbbf-756a-482c-99f0-a70ea04cffcd"}, "status": "reserved", "instance": "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0", "attached_at": "", "detached_at": "", "volume_id": "2901dbbf-756a-482c-99f0-a70ea04cffcd", "serial": "2901dbbf-756a-482c-99f0-a70ea04cffcd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2901dbbf-756a-482c-99f0-a70ea04cffcd', 'no_device': None, 'attachment_id': '1495a3ea-1e65-4bc8-87cd-ce01d7495bbf'} {{(pid=74075) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c01a7805-153a-4bd4-8fb7-a4bbe37b08ea tempest-TestVolumeSwap-1829051227 tempest-TestVolumeSwap-1829051227-project-admin] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 40.342s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-5e8d031a-d493-4d7f-afd3-6d4adac2d3e6 req-d45e7889-68e7-4e03-92d8-713fd010d9da service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-vif-unplugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5e8d031a-d493-4d7f-afd3-6d4adac2d3e6 req-d45e7889-68e7-4e03-92d8-713fd010d9da service nova] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5e8d031a-d493-4d7f-afd3-6d4adac2d3e6 req-d45e7889-68e7-4e03-92d8-713fd010d9da service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5e8d031a-d493-4d7f-afd3-6d4adac2d3e6 req-d45e7889-68e7-4e03-92d8-713fd010d9da service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-5e8d031a-d493-4d7f-afd3-6d4adac2d3e6 req-d45e7889-68e7-4e03-92d8-713fd010d9da service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] No waiting events found dispatching network-vif-unplugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-5e8d031a-d493-4d7f-afd3-6d4adac2d3e6 req-d45e7889-68e7-4e03-92d8-713fd010d9da service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-vif-unplugged-581e22e2-18c0-44aa-ad95-dabbe628d748 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Instance destroyed successfully.
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lazy-loading 'resources' on Instance uuid dd951a2e-120b-4ddb-81f9-ed4198e099a5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23232366134633162', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232366134633162', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-884873962',display_name='tempest-VolumesAssistedSnapshotsTest-server-884873962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-884873962',id=9,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+ntY7foSY2IrDCSfOw3s3tSjYB4kp201JwU48/QH5IlBpesXAiIGiG288uMxjdEWIRpmFQqNrYToet2AO6b8BsGXmwZTE9rRbuncSjeE6LYLn4vpj6x3+hf56V1L688w==',key_name='tempest-keypair-73154081',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='def8c9b1af2b4942887354a61898d4be',ramdisk_id='',reservation_id='r-exn606ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1848008629',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1848008629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='023aaa53dfdc419c93f6da7c6dabb11a',uuid=dd951a2e-120b-4ddb-81f9-ed4198e099a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Converting VIF {"id": "581e22e2-18c0-44aa-ad95-dabbe628d748", "address": "fa:16:3e:64:8c:05", "network": {"id": "e35eb57a-23c1-4269-95f2-2864453af31a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337600780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "def8c9b1af2b4942887354a61898d4be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581e22e2-18", "ovs_interfaceid": "581e22e2-18c0-44aa-ad95-dabbe628d748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG os_vif [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap581e22e2-18, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'pci_devices' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebd59594-0773-46e6-ab7e-38c2751e986b) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:43 user nova-compute[74075]: INFO os_vif [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8c:05,bridge_name='br-int',has_traffic_filtering=True,id=581e22e2-18c0-44aa-ad95-dabbe628d748,network=Network(e35eb57a-23c1-4269-95f2-2864453af31a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581e22e2-18')
Oct 26 09:28:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Deleting instance files /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5_del
Oct 26 09:28:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Deletion of /opt/stack/data/nova/instances/dd951a2e-120b-4ddb-81f9-ed4198e099a5_del complete
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:28:43 user nova-compute[74075]:   <uuid>e4baa273-79c9-408c-9c41-17e202582246</uuid>
Oct 26 09:28:43 user nova-compute[74075]:   <name>instance-00000004</name>
Oct 26 09:28:43 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:28:43 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:28:43 user nova-compute[74075]:   <metadata>
Oct 26 09:28:43 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:28:43 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:28:43 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeTestJSON-server-650728468</nova:name>
Oct 26 09:28:43 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:28:41</nova:creationTime>
Oct 26 09:28:43 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:28:43 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:28:43 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:28:43 user nova-compute[74075]:       <nova:owner>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:user uuid="454822c8719441388cd38cd86b736b3c">tempest-AttachVolumeTestJSON-1598575575-project-member</nova:user>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:project uuid="4c09f49b38ff4e4f96fa233d1c8e33f4">tempest-AttachVolumeTestJSON-1598575575</nova:project>
Oct 26 09:28:43 user nova-compute[74075]:       </nova:owner>
Oct 26 09:28:43 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:28:43 user nova-compute[74075]:       <nova:ports>
Oct 26 09:28:43 user nova-compute[74075]:         <nova:port uuid="bbf845ec-94f6-4489-a12d-2bc5cca19e8a">
Oct 26 09:28:43 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:28:43 user nova-compute[74075]:         </nova:port>
Oct 26 09:28:43 user nova-compute[74075]:       </nova:ports>
Oct 26 09:28:43 user nova-compute[74075]:     </nova:instance>
Oct 26 09:28:43 user nova-compute[74075]:   </metadata>
Oct 26 09:28:43 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:28:43 user nova-compute[74075]:     <system>
Oct 26 09:28:43 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:28:43 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:28:43 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:28:43 user nova-compute[74075]:       <entry name="serial">e4baa273-79c9-408c-9c41-17e202582246</entry>
Oct 26 09:28:43 user nova-compute[74075]:       <entry name="uuid">e4baa273-79c9-408c-9c41-17e202582246</entry>
Oct 26 09:28:43 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:28:43 user nova-compute[74075]:     </system>
Oct 26 09:28:43 user nova-compute[74075]:   </sysinfo>
Oct 26 09:28:43 user nova-compute[74075]:   <os>
Oct 26 09:28:43 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:28:43 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:28:43 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:28:43 user nova-compute[74075]:   </os>
Oct 26 09:28:43 user nova-compute[74075]:   <features>
Oct 26 09:28:43 user nova-compute[74075]:     <acpi/>
Oct 26 09:28:43 user nova-compute[74075]:     <apic/>
Oct 26 09:28:43 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:28:43 user nova-compute[74075]:   </features>
Oct 26 09:28:43 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:28:43 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:28:43 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:28:43 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:28:43 user nova-compute[74075]:   </clock>
Oct 26 09:28:43 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:28:43 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:28:43 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:28:43 user nova-compute[74075]:   </cpu>
Oct 26 09:28:43 user nova-compute[74075]:   <devices>
Oct 26 09:28:43 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:28:43 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:28:43 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk"/>
Oct 26 09:28:43 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:28:43 user nova-compute[74075]:     </disk>
Oct 26 09:28:43 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:28:43 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:28:43 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:28:43 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:28:43 user nova-compute[74075]:       <serial>8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d</serial>
Oct 26 09:28:43 user nova-compute[74075]:     </disk>
Oct 26 09:28:43 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:28:43 user nova-compute[74075]:       <mac address="fa:16:3e:b5:b5:5b"/>
Oct 26 09:28:43 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:28:43 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:28:43 user nova-compute[74075]:       <target dev="tapbbf845ec-94"/>
Oct 26 09:28:43 user nova-compute[74075]:     </interface>
Oct 26 09:28:43 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:28:43 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/console.log" append="off"/>
Oct 26 09:28:43 user nova-compute[74075]:     </serial>
Oct 26 09:28:43 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:28:43 user nova-compute[74075]:     <video>
Oct 26 09:28:43 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:28:43 user nova-compute[74075]:     </video>
Oct 26 09:28:43 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:28:43 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:28:43 user nova-compute[74075]:     </rng>
Oct 26 09:28:43 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:28:43 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:28:43 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:28:43 user nova-compute[74075]:     </memballoon>
Oct 26 09:28:43 user nova-compute[74075]:   </devices>
Oct 26 09:28:43 user nova-compute[74075]: </domain>
Oct 26 09:28:43 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:43 user nova-compute[74075]: INFO nova.compute.manager [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:28:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Cannot resize image /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'migration_context' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.objects.base [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG os_vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '612fcdba-9c77-5adb-839c-f977216dfdee', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbf845ec-94, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbf845ec-94, col_values=(('qos', UUID('16f2ae27-7113-4051-9938-f90cc67caaaf')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbf845ec-94, col_values=(('external_ids', {'iface-id': 'bbf845ec-94f6-4489-a12d-2bc5cca19e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b5:5b', 'vm-uuid': 'e4baa273-79c9-408c-9c41-17e202582246'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:44 user nova-compute[74075]: INFO os_vif [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94')
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:44 user nova-compute[74075]: INFO nova.compute.manager [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Detaching volume 2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:44 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Took 0.88 seconds to deallocate network for instance.
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a673714-fa5a-4ed0-ab18-f96b2e9fc3c4 req-1c6c46bc-756e-4a04-8ba4-24da1597ba36 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-vif-deleted-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:44 user nova-compute[74075]: INFO nova.compute.manager [req-1a673714-fa5a-4ed0-ab18-f96b2e9fc3c4 req-1c6c46bc-756e-4a04-8ba4-24da1597ba36 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Neutron deleted interface 581e22e2-18c0-44aa-ad95-dabbe628d748; detaching it from the instance and deleting it from the info cache
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-1a673714-fa5a-4ed0-ab18-f96b2e9fc3c4 req-1c6c46bc-756e-4a04-8ba4-24da1597ba36 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:44 user nova-compute[74075]: INFO nova.virt.block_device [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Attempting to driver detach volume 2901dbbf-756a-482c-99f0-a70ea04cffcd from mountpoint /dev/vdb
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a673714-fa5a-4ed0-ab18-f96b2e9fc3c4 req-1c6c46bc-756e-4a04-8ba4-24da1597ba36 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Detach interface failed, port_id=581e22e2-18c0-44aa-ad95-dabbe628d748, reason: Instance dd951a2e-120b-4ddb-81f9-ed4198e099a5 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Attempting to detach device vdb from instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:28:44 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:28:44 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:28:44 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:28:44 user nova-compute[74075]:   <serial>2901dbbf-756a-482c-99f0-a70ea04cffcd</serial>
Oct 26 09:28:44 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:28:44 user nova-compute[74075]: </disk>
Oct 26 09:28:44 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:28:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Successfully detached device vdb from instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 from the persistent domain config.
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:28:44 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:28:44 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:28:44 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:28:44 user nova-compute[74075]:   <serial>2901dbbf-756a-482c-99f0-a70ea04cffcd</serial>
Oct 26 09:28:44 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:28:44 user nova-compute[74075]: </disk>
Oct 26 09:28:44 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:44 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Deleted allocations for instance dd951a2e-120b-4ddb-81f9-ed4198e099a5
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-08d7598f-36b5-4b87-a5c4-c92c0505c990 tempest-VolumesAssistedSnapshotsTest-1848008629 tempest-VolumesAssistedSnapshotsTest-1848008629-project-member] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-113dc37a-459b-44fc-b3df-f16ea2dc3d04 req-32959b7a-a915-4434-a279-96e9441ddad1 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received event network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-113dc37a-459b-44fc-b3df-f16ea2dc3d04 req-32959b7a-a915-4434-a279-96e9441ddad1 service nova] Acquiring lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-113dc37a-459b-44fc-b3df-f16ea2dc3d04 req-32959b7a-a915-4434-a279-96e9441ddad1 service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-113dc37a-459b-44fc-b3df-f16ea2dc3d04 req-32959b7a-a915-4434-a279-96e9441ddad1 service nova] Lock "dd951a2e-120b-4ddb-81f9-ed4198e099a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-113dc37a-459b-44fc-b3df-f16ea2dc3d04 req-32959b7a-a915-4434-a279-96e9441ddad1 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] No waiting events found dispatching network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:44 user nova-compute[74075]: WARNING nova.compute.manager [req-113dc37a-459b-44fc-b3df-f16ea2dc3d04 req-32959b7a-a915-4434-a279-96e9441ddad1 service nova] [instance: dd951a2e-120b-4ddb-81f9-ed4198e099a5] Received unexpected event network-vif-plugged-581e22e2-18c0-44aa-ad95-dabbe628d748 for instance with vm_state deleted and task_state None.
Oct 26 09:28:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:47 user nova-compute[74075]: WARNING nova.compute.manager [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state stopped and task_state powering-on.
Oct 26 09:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:47 user nova-compute[74075]: WARNING nova.compute.manager [req-a3e38c0a-3ed9-4922-a8ad-3bc57229f8eb req-33e1b716-8008-4754-95bf-abc71b018392 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state stopped and task_state powering-on.
Oct 26 09:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:28:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance rebooted successfully.
Oct 26 09:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-daf59c0b-96d1-41c5-a6cb-16d41e49765f tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:28:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:28:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:28:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:28:49 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating instance_info_cache with network_info: [{"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-17b8e7c7-a424-4101-86eb-c62708543f06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:50 user nova-compute[74075]: INFO nova.compute.manager [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Terminating instance
Oct 26 09:28:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-ebab7290-be5e-4bc4-adf9-b6824f738b9d req-db8f6c63-fff1-4978-8386-061aae2fad4a service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-unplugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ebab7290-be5e-4bc4-adf9-b6824f738b9d req-db8f6c63-fff1-4978-8386-061aae2fad4a service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ebab7290-be5e-4bc4-adf9-b6824f738b9d req-db8f6c63-fff1-4978-8386-061aae2fad4a service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ebab7290-be5e-4bc4-adf9-b6824f738b9d req-db8f6c63-fff1-4978-8386-061aae2fad4a service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-ebab7290-be5e-4bc4-adf9-b6824f738b9d req-db8f6c63-fff1-4978-8386-061aae2fad4a service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-unplugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-ebab7290-be5e-4bc4-adf9-b6824f738b9d req-db8f6c63-fff1-4978-8386-061aae2fad4a service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-unplugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Instance destroyed successfully.
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lazy-loading 'resources' on Instance uuid 8a38837e-a0c6-43c2-af40-ad1db9d651ce {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189807003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189807003',id=8,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwaYw8j7i9z4c+yVIBuP1YRl8nx7tl1G0VHciSNH4hv+rIYBneHHcO6mH6VzG2SOIzB+1vz0dQ/2fOEBAg7matAcg+m4aIXGMjJ5cuBCgm6vj8v7OCC+osP0ua8OVpPew==',key_name='tempest-keypair-1393849510',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a90cafbb4d16495b834e4972d0ff2004',ramdisk_id='',reservation_id='r-wm0ws4c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1885075461',owner_user_name='tempest-TaggedAttachmentsTest-1885075461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e51f861aca4648bd3076ac06369d7a',uuid=8a38837e-a0c6-43c2-af40-ad1db9d651ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converting VIF {"id": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "address": "fa:16:3e:a2:4b:20", "network": {"id": "ebc8a766-ca43-49af-96ad-b2f0645369d6", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555507329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a90cafbb4d16495b834e4972d0ff2004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525d4cf-2e", "ovs_interfaceid": "7525d4cf-2e19-4d31-8f4c-61c0a6de017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG os_vif [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7525d4cf-2e, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8583b9f-74cf-4770-8021-782814463b32) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:51 user nova-compute[74075]: INFO os_vif [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4b:20,bridge_name='br-int',has_traffic_filtering=True,id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e,network=Network(ebc8a766-ca43-49af-96ad-b2f0645369d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525d4cf-2e')
Oct 26 09:28:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Deleting instance files /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce_del
Oct 26 09:28:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Deletion of /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce_del complete
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json" returned: 1 in 0.278s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk --force-share --output=json' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:28:51 user nova-compute[74075]: INFO nova.compute.manager [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:28:51 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000008, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/8a38837e-a0c6-43c2-af40-ad1db9d651ce/disk
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:28:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-a08921d8-9b8d-4427-a806-f589e30d760d req-25ad12e3-d097-486f-8688-f8874668d798 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-deleted-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:52 user nova-compute[74075]: INFO nova.compute.manager [req-a08921d8-9b8d-4427-a806-f589e30d760d req-25ad12e3-d097-486f-8688-f8874668d798 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Neutron deleted interface 7525d4cf-2e19-4d31-8f4c-61c0a6de017e; detaching it from the instance and deleting it from the info cache
Oct 26 09:28:52 user nova-compute[74075]: DEBUG nova.network.neutron [req-a08921d8-9b8d-4427-a806-f589e30d760d req-25ad12e3-d097-486f-8688-f8874668d798 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:52 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:28:52 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Took 1.13 seconds to deallocate network for instance.
Oct 26 09:28:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-a08921d8-9b8d-4427-a806-f589e30d760d req-25ad12e3-d097-486f-8688-f8874668d798 service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Detach interface failed, port_id=7525d4cf-2e19-4d31-8f4c-61c0a6de017e, reason: Instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-06f56f2c-dc3a-48fe-ab40-4ea0d5d06edf req-88f3df5b-0bec-43c2-b365-3db005635d5e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received event network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-06f56f2c-dc3a-48fe-ab40-4ea0d5d06edf req-88f3df5b-0bec-43c2-b365-3db005635d5e service nova] Acquiring lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-06f56f2c-dc3a-48fe-ab40-4ea0d5d06edf req-88f3df5b-0bec-43c2-b365-3db005635d5e service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-06f56f2c-dc3a-48fe-ab40-4ea0d5d06edf req-88f3df5b-0bec-43c2-b365-3db005635d5e service nova] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-06f56f2c-dc3a-48fe-ab40-4ea0d5d06edf req-88f3df5b-0bec-43c2-b365-3db005635d5e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] No waiting events found dispatching network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:28:53 user nova-compute[74075]: WARNING nova.compute.manager [req-06f56f2c-dc3a-48fe-ab40-4ea0d5d06edf req-88f3df5b-0bec-43c2-b365-3db005635d5e service nova] [instance: 8a38837e-a0c6-43c2-af40-ad1db9d651ce] Received unexpected event network-vif-plugged-7525d4cf-2e19-4d31-8f4c-61c0a6de017e for instance with vm_state active and task_state deleting.
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:53 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Deleted allocations for instance 8a38837e-a0c6-43c2-af40-ad1db9d651ce
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5bb00929-853c-4d08-bc6d-b90f34d5e1c8 tempest-TaggedAttachmentsTest-1885075461 tempest-TaggedAttachmentsTest-1885075461-project-member] Lock "8a38837e-a0c6-43c2-af40-ad1db9d651ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.272s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:28:55 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:28:55 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7939MB free_disk=25.530181884765625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 7635aa37-fdd4-4443-91e7-81743eaf3672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:28:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:28:56 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:28:56 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:28:56 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:28:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:28:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:28:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:28:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:29:00 user nova-compute[74075]: INFO nova.compute.manager [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Rescuing
Oct 26 09:29:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:29:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:29:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:29:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:29:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:29:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-af59ba20-6ada-48ba-bea1-b9c35a520e47 req-e38351c2-30a0-44d5-88f9-f72f8a16f590 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-af59ba20-6ada-48ba-bea1-b9c35a520e47 req-e38351c2-30a0-44d5-88f9-f72f8a16f590 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-af59ba20-6ada-48ba-bea1-b9c35a520e47 req-e38351c2-30a0-44d5-88f9-f72f8a16f590 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-af59ba20-6ada-48ba-bea1-b9c35a520e47 req-e38351c2-30a0-44d5-88f9-f72f8a16f590 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-af59ba20-6ada-48ba-bea1-b9c35a520e47 req-e38351c2-30a0-44d5-88f9-f72f8a16f590 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:29:01 user nova-compute[74075]: WARNING nova.compute.manager [req-af59ba20-6ada-48ba-bea1-b9c35a520e47 req-e38351c2-30a0-44d5-88f9-f72f8a16f590 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state active and task_state rescuing.
Oct 26 09:29:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance destroyed successfully.
Oct 26 09:29:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Attempting rescue
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74075) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:29:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Creating image(s)
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.222s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue" returned: 0 in 0.052s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'migration_context' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.base [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<8999f490-1fc8-443a-bfaa-6a580681f2b8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Start _get_guest_xml network_info=[{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:24:18:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'resources' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.base [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<8999f490-1fc8-443a-bfaa-6a580681f2b8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'numa_topology' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.base [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<8999f490-1fc8-443a-bfaa-6a580681f2b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:29:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:29:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.base [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<8999f490-1fc8-443a-bfaa-6a580681f2b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1620232250',display_name='tempest-ServerRescueNegativeTestJSON-server-1620232250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1620232250',id=1,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-0iyo9h64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:24:22Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=8999f490-1fc8-443a-bfaa-6a580681f2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:24:18:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:24:18:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'pci_devices' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.objects.base [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<8999f490-1fc8-443a-bfaa-6a580681f2b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:29:01 user nova-compute[74075]:   <uuid>8999f490-1fc8-443a-bfaa-6a580681f2b8</uuid>
Oct 26 09:29:01 user nova-compute[74075]:   <name>instance-00000001</name>
Oct 26 09:29:01 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:29:01 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:29:01 user nova-compute[74075]:   <metadata>
Oct 26 09:29:01 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:29:01 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:29:01 user nova-compute[74075]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1620232250</nova:name>
Oct 26 09:29:01 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:29:01</nova:creationTime>
Oct 26 09:29:01 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:29:01 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:29:01 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:29:01 user nova-compute[74075]:       <nova:owner>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:user uuid="82d86b9184a1410db33192820885da0f">tempest-ServerRescueNegativeTestJSON-336149992-project-member</nova:user>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:project uuid="e453d88800e642b98d9b66dde5fe2e73">tempest-ServerRescueNegativeTestJSON-336149992</nova:project>
Oct 26 09:29:01 user nova-compute[74075]:       </nova:owner>
Oct 26 09:29:01 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:29:01 user nova-compute[74075]:       <nova:ports>
Oct 26 09:29:01 user nova-compute[74075]:         <nova:port uuid="a73df641-2c14-4ee8-b7fb-f0e08c11a445">
Oct 26 09:29:01 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:29:01 user nova-compute[74075]:         </nova:port>
Oct 26 09:29:01 user nova-compute[74075]:       </nova:ports>
Oct 26 09:29:01 user nova-compute[74075]:     </nova:instance>
Oct 26 09:29:01 user nova-compute[74075]:   </metadata>
Oct 26 09:29:01 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:29:01 user nova-compute[74075]:     <system>
Oct 26 09:29:01 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:29:01 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:29:01 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:29:01 user nova-compute[74075]:       <entry name="serial">8999f490-1fc8-443a-bfaa-6a580681f2b8</entry>
Oct 26 09:29:01 user nova-compute[74075]:       <entry name="uuid">8999f490-1fc8-443a-bfaa-6a580681f2b8</entry>
Oct 26 09:29:01 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:29:01 user nova-compute[74075]:     </system>
Oct 26 09:29:01 user nova-compute[74075]:   </sysinfo>
Oct 26 09:29:01 user nova-compute[74075]:   <os>
Oct 26 09:29:01 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:29:01 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:29:01 user nova-compute[74075]:   </os>
Oct 26 09:29:01 user nova-compute[74075]:   <features>
Oct 26 09:29:01 user nova-compute[74075]:     <acpi/>
Oct 26 09:29:01 user nova-compute[74075]:     <apic/>
Oct 26 09:29:01 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:29:01 user nova-compute[74075]:   </features>
Oct 26 09:29:01 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:29:01 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:29:01 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:29:01 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:29:01 user nova-compute[74075]:   </clock>
Oct 26 09:29:01 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:29:01 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:29:01 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:29:01 user nova-compute[74075]:   </cpu>
Oct 26 09:29:01 user nova-compute[74075]:   <devices>
Oct 26 09:29:01 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:29:01 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:29:01 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue"/>
Oct 26 09:29:01 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:29:01 user nova-compute[74075]:     </disk>
Oct 26 09:29:01 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:29:01 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:29:01 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk"/>
Oct 26 09:29:01 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:29:01 user nova-compute[74075]:     </disk>
Oct 26 09:29:01 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:29:01 user nova-compute[74075]:       <mac address="fa:16:3e:24:18:70"/>
Oct 26 09:29:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:29:01 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:29:01 user nova-compute[74075]:       <target dev="tapa73df641-2c"/>
Oct 26 09:29:01 user nova-compute[74075]:     </interface>
Oct 26 09:29:01 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:29:01 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/console.log" append="off"/>
Oct 26 09:29:01 user nova-compute[74075]:     </serial>
Oct 26 09:29:01 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:29:01 user nova-compute[74075]:     <video>
Oct 26 09:29:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:29:01 user nova-compute[74075]:     </video>
Oct 26 09:29:01 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:29:01 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:29:01 user nova-compute[74075]:     </rng>
Oct 26 09:29:01 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:29:01 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:29:01 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:29:01 user nova-compute[74075]:     </memballoon>
Oct 26 09:29:01 user nova-compute[74075]:   </devices>
Oct 26 09:29:01 user nova-compute[74075]: </domain>
Oct 26 09:29:01 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:29:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance destroyed successfully.
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:29:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:24:18:70, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a1c5ff85-320d-43ce-a295-ba683afc6a20 req-392e52c0-4273-4577-95d0-d693c6b04816 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a1c5ff85-320d-43ce-a295-ba683afc6a20 req-392e52c0-4273-4577-95d0-d693c6b04816 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a1c5ff85-320d-43ce-a295-ba683afc6a20 req-392e52c0-4273-4577-95d0-d693c6b04816 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a1c5ff85-320d-43ce-a295-ba683afc6a20 req-392e52c0-4273-4577-95d0-d693c6b04816 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a1c5ff85-320d-43ce-a295-ba683afc6a20 req-392e52c0-4273-4577-95d0-d693c6b04816 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:29:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a1c5ff85-320d-43ce-a295-ba683afc6a20 req-392e52c0-4273-4577-95d0-d693c6b04816 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state active and task_state rescuing.
Oct 26 09:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 is timed out.
Oct 26 09:29:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Successfully detached device vdb from instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 from the live domain config.
Oct 26 09:29:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfYGwAqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '2901dbbf-756a-482c-99f0-a70ea04cffcd'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:29:04 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5badc-699c-4301-b372-93fbf784892a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:29:04 user nova-compute[74075]: No targets found.
Oct 26 09:29:04 user nova-compute[74075]: iSNS:
Oct 26 09:29:04 user nova-compute[74075]: No targets found.
Oct 26 09:29:04 user nova-compute[74075]: STATIC:
Oct 26 09:29:04 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd
Oct 26 09:29:04 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:29:04 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:29:04 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:29:04 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:29:04 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:29:04 user nova-compute[74075]: FIRMWARE:
Oct 26 09:29:04 user nova-compute[74075]: No targets found.
Oct 26 09:29:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:29:04 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:29:04 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b245da-4f79-47b8-b475-a3c5d531d7a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[20de8d9e-7150-45ad-8d1a-0d51893f133a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:29:04 user nova-compute[74075]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:29:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd (non-flash)
Oct 26 09:29:04 user nova-compute[74075]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:29:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c279990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b39c85-77c1-4445-b01f-02d5f89d5a78]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[886945f2-e2a4-412b-a5ca-c210dc603006]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a341c-4119-4db6-9371-263aba2e6ec8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e71cab-7a34-4733-a4fc-467eacbb0f91]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:29:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b3db7-c00b-43e0-86c0-6166d7207908]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590fe77-d229-46f3-9fd7-52af91ffff77]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260]
Oct 26 09:29:05 user nova-compute[74075]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd, portal: 172.16.0.220,3260] successful.
Oct 26 09:29:05 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2901dbbf-756a-482c-99f0-a70ea04cffcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65edf7b-d6e7-4297-ab09-b4f8059b7a21]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] <== disconnect_volume: return (299ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:29:05 user nova-compute[74075]: WARNING nova.compute.manager [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state active and task_state rescuing.
Oct 26 09:29:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:29:05 user nova-compute[74075]: WARNING nova.compute.manager [req-dfb74fd7-46f1-4996-821d-52224e010f78 req-cdb847d3-8c75-4863-8b59-ba872ae305ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state active and task_state rescuing.
Oct 26 09:29:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-61b46a7d-5cf7-4b47-8a2f-2e08cc01ba98 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:29:06 user nova-compute[74075]: DEBUG nova.objects.instance [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lazy-loading 'flavor' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0b7f7238-38f3-4682-9d62-8c38bf31d3e6 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.999s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:34 user nova-compute[74075]: INFO nova.compute.manager [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Terminating instance
Oct 26 09:29:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Instance destroyed successfully.
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lazy-loading 'resources' on Instance uuid 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1660728280',display_name='tempest-TestVolumeSwap-server-1660728280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1660728280',id=7,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnx5NnplzItllHF5/5SOkdepxVb7XWu0bQl3O92OZcCoI5r3YBIOfaoixG03552DwIARQAhesyNsJuqi7nUaZ0viblmOYGJKLvSlZ5uYGEn1DEXy9JH462rAMgikekIjA==',key_name='tempest-keypair-918549677',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b08100469d43a88508707a8e6d2a89',ramdisk_id='',reservation_id='r-9moenxt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1378683366',owner_user_name='tempest-TestVolumeSwap-1378683366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c15f18b959d41939d56108d7e5bd4c4',uuid=771ed6ed-15e1-40a8-8ad7-f11dd424f4a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Converting VIF {"id": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "address": "fa:16:3e:19:fc:e8", "network": {"id": "98246925-d516-4409-819b-89fe342a06a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2024072796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b08100469d43a88508707a8e6d2a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13bbf9da-ac", "ovs_interfaceid": "13bbf9da-ac50-405f-a1bb-346c1a79b1c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG os_vif [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13bbf9da-ac, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfc63015-f526-4039-bf47-2f28797842c4) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:35 user nova-compute[74075]: INFO os_vif [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=13bbf9da-ac50-405f-a1bb-346c1a79b1c3,network=Network(98246925-d516-4409-819b-89fe342a06a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13bbf9da-ac')
Oct 26 09:29:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Deleting instance files /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0_del
Oct 26 09:29:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Deletion of /opt/stack/data/nova/instances/771ed6ed-15e1-40a8-8ad7-f11dd424f4a0_del complete
Oct 26 09:29:35 user nova-compute[74075]: INFO nova.compute.manager [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 09:29:35 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-2b75b080-78e1-488d-a4c3-b99037af582e req-3d1a755e-d524-4f6e-b300-0212d1edfa4b service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-vif-unplugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2b75b080-78e1-488d-a4c3-b99037af582e req-3d1a755e-d524-4f6e-b300-0212d1edfa4b service nova] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2b75b080-78e1-488d-a4c3-b99037af582e req-3d1a755e-d524-4f6e-b300-0212d1edfa4b service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2b75b080-78e1-488d-a4c3-b99037af582e req-3d1a755e-d524-4f6e-b300-0212d1edfa4b service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-2b75b080-78e1-488d-a4c3-b99037af582e req-3d1a755e-d524-4f6e-b300-0212d1edfa4b service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] No waiting events found dispatching network-vif-unplugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:29:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-2b75b080-78e1-488d-a4c3-b99037af582e req-3d1a755e-d524-4f6e-b300-0212d1edfa4b service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-vif-unplugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:29:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:29:37 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Took 1.94 seconds to deallocate network for instance.
Oct 26 09:29:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ed49440-d710-4d19-84a0-2964a6850a8c req-f0091277-c64e-4976-9c4d-6b1e9f264a40 service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-vif-deleted-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-40ed5483-6d51-4a38-8aab-92bee45400f5 req-33ff9472-d7c5-4501-8375-fb15430bf89d service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received event network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-40ed5483-6d51-4a38-8aab-92bee45400f5 req-33ff9472-d7c5-4501-8375-fb15430bf89d service nova] Acquiring lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-40ed5483-6d51-4a38-8aab-92bee45400f5 req-33ff9472-d7c5-4501-8375-fb15430bf89d service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-40ed5483-6d51-4a38-8aab-92bee45400f5 req-33ff9472-d7c5-4501-8375-fb15430bf89d service nova] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-40ed5483-6d51-4a38-8aab-92bee45400f5 req-33ff9472-d7c5-4501-8375-fb15430bf89d service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] No waiting events found dispatching network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:29:37 user nova-compute[74075]: WARNING nova.compute.manager [req-40ed5483-6d51-4a38-8aab-92bee45400f5 req-33ff9472-d7c5-4501-8375-fb15430bf89d service nova] [instance: 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0] Received unexpected event network-vif-plugged-13bbf9da-ac50-405f-a1bb-346c1a79b1c3 for instance with vm_state deleted and task_state None.
Oct 26 09:29:37 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Deleted allocations for instance 771ed6ed-15e1-40a8-8ad7-f11dd424f4a0
Oct 26 09:29:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8fc03c25-1b3e-4a78-aaaa-d34fef9f46f1 tempest-TestVolumeSwap-1378683366 tempest-TestVolumeSwap-1378683366-project-member] Lock "771ed6ed-15e1-40a8-8ad7-f11dd424f4a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.438s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:29:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:29:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:29:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:29:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:29:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:29:55 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:29:55 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=25.610946655273438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 7635aa37-fdd4-4443-91e7-81743eaf3672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:29:55 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:29:56 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:29:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.775s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:29:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:29:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:29:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:29:59 user nova-compute[74075]: INFO nova.compute.claims [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Claim successful on node user
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.network.neutron [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:29:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.policy [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05e6ea9a6e248e892fb237a31d4b1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf8f091fdd04a9c8e5b14632402efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:29:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Creating image(s)
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "/opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:29:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Successfully created port: b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Cannot resize image /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Ensure instance console log exists: /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Successfully updated port: b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-changed-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Refreshing instance network info cache due to event network-changed-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] Acquiring lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Instance network_info: |[{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] Acquired lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Refreshing network info cache for port b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Start _get_guest_xml network_info=[{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:30:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:30:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1492139127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1492139127',id=12,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-dxzt7m7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:00Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=30d9df05-0182-4fb0-8a03-10d47bc7b0a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'pci_devices' on Instance uuid 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:30:01 user nova-compute[74075]:   <uuid>30d9df05-0182-4fb0-8a03-10d47bc7b0a2</uuid>
Oct 26 09:30:01 user nova-compute[74075]:   <name>instance-0000000c</name>
Oct 26 09:30:01 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:30:01 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:30:01 user nova-compute[74075]:   <metadata>
Oct 26 09:30:01 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:30:01 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:30:01 user nova-compute[74075]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1492139127</nova:name>
Oct 26 09:30:01 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:30:01</nova:creationTime>
Oct 26 09:30:01 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:30:01 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:30:01 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:30:01 user nova-compute[74075]:       <nova:owner>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:user uuid="f05e6ea9a6e248e892fb237a31d4b1a1">tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member</nova:user>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:project uuid="abf8f091fdd04a9c8e5b14632402efae">tempest-ServerBootFromVolumeStableRescueTest-1733320520</nova:project>
Oct 26 09:30:01 user nova-compute[74075]:       </nova:owner>
Oct 26 09:30:01 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:30:01 user nova-compute[74075]:       <nova:ports>
Oct 26 09:30:01 user nova-compute[74075]:         <nova:port uuid="b205118a-ccc4-4fb4-bc46-5d0c0ab3702e">
Oct 26 09:30:01 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:30:01 user nova-compute[74075]:         </nova:port>
Oct 26 09:30:01 user nova-compute[74075]:       </nova:ports>
Oct 26 09:30:01 user nova-compute[74075]:     </nova:instance>
Oct 26 09:30:01 user nova-compute[74075]:   </metadata>
Oct 26 09:30:01 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:30:01 user nova-compute[74075]:     <system>
Oct 26 09:30:01 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:30:01 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:30:01 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:30:01 user nova-compute[74075]:       <entry name="serial">30d9df05-0182-4fb0-8a03-10d47bc7b0a2</entry>
Oct 26 09:30:01 user nova-compute[74075]:       <entry name="uuid">30d9df05-0182-4fb0-8a03-10d47bc7b0a2</entry>
Oct 26 09:30:01 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:30:01 user nova-compute[74075]:     </system>
Oct 26 09:30:01 user nova-compute[74075]:   </sysinfo>
Oct 26 09:30:01 user nova-compute[74075]:   <os>
Oct 26 09:30:01 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:30:01 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:30:01 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:30:01 user nova-compute[74075]:   </os>
Oct 26 09:30:01 user nova-compute[74075]:   <features>
Oct 26 09:30:01 user nova-compute[74075]:     <acpi/>
Oct 26 09:30:01 user nova-compute[74075]:     <apic/>
Oct 26 09:30:01 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:30:01 user nova-compute[74075]:   </features>
Oct 26 09:30:01 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:30:01 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:30:01 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:30:01 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:30:01 user nova-compute[74075]:   </clock>
Oct 26 09:30:01 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:30:01 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:30:01 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:30:01 user nova-compute[74075]:   </cpu>
Oct 26 09:30:01 user nova-compute[74075]:   <devices>
Oct 26 09:30:01 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:30:01 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:30:01 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk"/>
Oct 26 09:30:01 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:30:01 user nova-compute[74075]:     </disk>
Oct 26 09:30:01 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:30:01 user nova-compute[74075]:       <mac address="fa:16:3e:2d:8e:f8"/>
Oct 26 09:30:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:30:01 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:30:01 user nova-compute[74075]:       <target dev="tapb205118a-cc"/>
Oct 26 09:30:01 user nova-compute[74075]:     </interface>
Oct 26 09:30:01 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:30:01 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/console.log" append="off"/>
Oct 26 09:30:01 user nova-compute[74075]:     </serial>
Oct 26 09:30:01 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:30:01 user nova-compute[74075]:     <video>
Oct 26 09:30:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:30:01 user nova-compute[74075]:     </video>
Oct 26 09:30:01 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:30:01 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:30:01 user nova-compute[74075]:     </rng>
Oct 26 09:30:01 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:30:01 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:30:01 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:30:01 user nova-compute[74075]:     </memballoon>
Oct 26 09:30:01 user nova-compute[74075]:   </devices>
Oct 26 09:30:01 user nova-compute[74075]: </domain>
Oct 26 09:30:01 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1492139127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1492139127',id=12,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-dxzt7m7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:00Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=30d9df05-0182-4fb0-8a03-10d47bc7b0a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG os_vif [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de5440d3-ef06-533f-83fc-ed1f1576800b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb205118a-cc, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb205118a-cc, col_values=(('qos', UUID('08bee515-d228-4a84-8649-56c54d11c634')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb205118a-cc, col_values=(('external_ids', {'iface-id': 'b205118a-ccc4-4fb4-bc46-5d0c0ab3702e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:8e:f8', 'vm-uuid': '30d9df05-0182-4fb0-8a03-10d47bc7b0a2'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:01 user nova-compute[74075]: INFO os_vif [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc')
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No VIF found with MAC fa:16:3e:2d:8e:f8, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updated VIF entry in instance network info cache for port b205118a-ccc4-4fb4-bc46-5d0c0ab3702e. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e365acfc-fa61-4e1a-974b-df7fe9cb574e req-0cfd563a-e3b2-462e-ba50-6a236795a63c service nova] Releasing lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-9cd1f60d-4146-4219-bd34-b5b4b292e9b0 req-052640e3-516d-4d5b-9d47-240f7d527ed6 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9cd1f60d-4146-4219-bd34-b5b4b292e9b0 req-052640e3-516d-4d5b-9d47-240f7d527ed6 service nova] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9cd1f60d-4146-4219-bd34-b5b4b292e9b0 req-052640e3-516d-4d5b-9d47-240f7d527ed6 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9cd1f60d-4146-4219-bd34-b5b4b292e9b0 req-052640e3-516d-4d5b-9d47-240f7d527ed6 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-9cd1f60d-4146-4219-bd34-b5b4b292e9b0 req-052640e3-516d-4d5b-9d47-240f7d527ed6 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] No waiting events found dispatching network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:03 user nova-compute[74075]: WARNING nova.compute.manager [req-9cd1f60d-4146-4219-bd34-b5b4b292e9b0 req-052640e3-516d-4d5b-9d47-240f7d527ed6 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received unexpected event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e for instance with vm_state building and task_state spawning.
Oct 26 09:30:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:30:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Instance spawned successfully.
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-1168bf1b-089e-4958-ac0b-94cdfc5d91e9 req-cc19f4c7-fb3e-4df8-9535-444c990562b7 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1168bf1b-089e-4958-ac0b-94cdfc5d91e9 req-cc19f4c7-fb3e-4df8-9535-444c990562b7 service nova] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1168bf1b-089e-4958-ac0b-94cdfc5d91e9 req-cc19f4c7-fb3e-4df8-9535-444c990562b7 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1168bf1b-089e-4958-ac0b-94cdfc5d91e9 req-cc19f4c7-fb3e-4df8-9535-444c990562b7 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-1168bf1b-089e-4958-ac0b-94cdfc5d91e9 req-cc19f4c7-fb3e-4df8-9535-444c990562b7 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] No waiting events found dispatching network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:05 user nova-compute[74075]: WARNING nova.compute.manager [req-1168bf1b-089e-4958-ac0b-94cdfc5d91e9 req-cc19f4c7-fb3e-4df8-9535-444c990562b7 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received unexpected event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e for instance with vm_state building and task_state spawning.
Oct 26 09:30:05 user nova-compute[74075]: INFO nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 26 09:30:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:30:05 user nova-compute[74075]: INFO nova.compute.manager [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Took 5.98 seconds to build instance.
Oct 26 09:30:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-183699e8-5db7-47b3-946d-aa5337d2fec7 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.125s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:23 user nova-compute[74075]: INFO nova.compute.manager [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Terminating instance
Oct 26 09:30:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-16010962-7027-40c8-893c-09c308bf1cb6 req-4e91625b-ed07-4811-91ca-218a8b8b65eb service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-vif-unplugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-16010962-7027-40c8-893c-09c308bf1cb6 req-4e91625b-ed07-4811-91ca-218a8b8b65eb service nova] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-16010962-7027-40c8-893c-09c308bf1cb6 req-4e91625b-ed07-4811-91ca-218a8b8b65eb service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-16010962-7027-40c8-893c-09c308bf1cb6 req-4e91625b-ed07-4811-91ca-218a8b8b65eb service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-16010962-7027-40c8-893c-09c308bf1cb6 req-4e91625b-ed07-4811-91ca-218a8b8b65eb service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] No waiting events found dispatching network-vif-unplugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.compute.manager [req-16010962-7027-40c8-893c-09c308bf1cb6 req-4e91625b-ed07-4811-91ca-218a8b8b65eb service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-vif-unplugged-22717075-d033-49be-87ac-28d7e741a229 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:30:24 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Instance destroyed successfully.
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.objects.instance [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'resources' on Instance uuid 7635aa37-fdd4-4443-91e7-81743eaf3672 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1887157309',display_name='tempest-VolumesAdminNegativeTest-server-1887157309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1887157309',id=11,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f45c95858d242088d115e4e062f1c55',ramdisk_id='',reservation_id='r-l0i0nmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1450530067',owner_user_name='tempest-VolumesAdminNegativeTest-1450530067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:28:24Z,user_data=None,user_id='c1003917645d47fa97204a5120eccadf',uuid=7635aa37-fdd4-4443-91e7-81743eaf3672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converting VIF {"id": "22717075-d033-49be-87ac-28d7e741a229", "address": "fa:16:3e:a4:0a:ca", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22717075-d0", "ovs_interfaceid": "22717075-d033-49be-87ac-28d7e741a229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG os_vif [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22717075-d0, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2d9ab3e-93e4-411f-8dc5-7231b8375213) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:30:24 user nova-compute[74075]: INFO os_vif [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:0a:ca,bridge_name='br-int',has_traffic_filtering=True,id=22717075-d033-49be-87ac-28d7e741a229,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22717075-d0')
Oct 26 09:30:24 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Deleting instance files /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672_del
Oct 26 09:30:24 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Deletion of /opt/stack/data/nova/instances/7635aa37-fdd4-4443-91e7-81743eaf3672_del complete
Oct 26 09:30:24 user nova-compute[74075]: INFO nova.compute.manager [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 09:30:24 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:30:24 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:30:25 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:25 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Took 0.86 seconds to deallocate network for instance.
Oct 26 09:30:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:25 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:30:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:30:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:25 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Deleted allocations for instance 7635aa37-fdd4-4443-91e7-81743eaf3672
Oct 26 09:30:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bddfea37-3af0-4bfe-bbc8-b331947646a4 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] Acquiring lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] Lock "7635aa37-fdd4-4443-91e7-81743eaf3672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] No waiting events found dispatching network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:26 user nova-compute[74075]: WARNING nova.compute.manager [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received unexpected event network-vif-plugged-22717075-d033-49be-87ac-28d7e741a229 for instance with vm_state deleted and task_state None.
Oct 26 09:30:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-a5b7c09d-2c5c-4790-bb0a-680660504336 req-0f221895-4c23-4937-97a4-cf264cbb8140 service nova] [instance: 7635aa37-fdd4-4443-91e7-81743eaf3672] Received event network-vif-deleted-22717075-d033-49be-87ac-28d7e741a229 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:32 user nova-compute[74075]: INFO nova.compute.manager [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Detaching volume 8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:30:32 user nova-compute[74075]: INFO nova.virt.block_device [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Attempting to driver detach volume 8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d from mountpoint /dev/vdb
Oct 26 09:30:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Attempting to detach device vdb from instance e4baa273-79c9-408c-9c41-17e202582246 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:30:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:30:32 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:30:32 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:30:32 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:30:32 user nova-compute[74075]:   <serial>8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d</serial>
Oct 26 09:30:32 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 09:30:32 user nova-compute[74075]: </disk>
Oct 26 09:30:32 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:30:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully detached device vdb from instance e4baa273-79c9-408c-9c41-17e202582246 from the persistent domain config.
Oct 26 09:30:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4baa273-79c9-408c-9c41-17e202582246 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:30:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:30:32 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:30:32 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:30:32 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:30:32 user nova-compute[74075]:   <serial>8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d</serial>
Oct 26 09:30:32 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 09:30:32 user nova-compute[74075]: </disk>
Oct 26 09:30:32 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:30:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:30:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:30:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:37 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:30:37 user nova-compute[74075]: INFO nova.compute.claims [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Claim successful on node user
Oct 26 09:30:37 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:30:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.policy [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72e41eeb99a44dde89e0c8530c4c3dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd989d010e8bf4fcabfc7f5109432fa29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:30:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Creating image(s)
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "/opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "/opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.260s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk 1073741824" returned: 0 in 0.057s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Successfully created port: fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.222s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Cannot resize image /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Ensure instance console log exists: /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Successfully updated port: fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquired lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-changed-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Refreshing instance network info cache due to event network-changed-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] Acquiring lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updating instance_info_cache with network_info: [{"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Releasing lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Instance network_info: |[{"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] Acquired lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Refreshing network info cache for port fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Start _get_guest_xml network_info=[{"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:30:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:30:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1854875769',display_name='tempest-ServersNegativeTestJSON-server-1854875769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1854875769',id=13,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d989d010e8bf4fcabfc7f5109432fa29',ramdisk_id='',reservation_id='r-6nse3gb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2029109923',owner_user_name='tempest-ServersNegativeTestJSON-2029109923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:38Z,user_data=None,user_id='72e41eeb99a44dde89e0c8530c4c3dbd',uuid=dd7a3ed2-b161-4950-bbcc-8de9c33e2275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converting VIF {"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.objects.instance [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lazy-loading 'pci_devices' on Instance uuid dd7a3ed2-b161-4950-bbcc-8de9c33e2275 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:30:40 user nova-compute[74075]:   <uuid>dd7a3ed2-b161-4950-bbcc-8de9c33e2275</uuid>
Oct 26 09:30:40 user nova-compute[74075]:   <name>instance-0000000d</name>
Oct 26 09:30:40 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:30:40 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:30:40 user nova-compute[74075]:   <metadata>
Oct 26 09:30:40 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:30:40 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:30:40 user nova-compute[74075]:       <nova:name>tempest-ServersNegativeTestJSON-server-1854875769</nova:name>
Oct 26 09:30:40 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:30:40</nova:creationTime>
Oct 26 09:30:40 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:30:40 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:30:40 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:30:40 user nova-compute[74075]:       <nova:owner>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:user uuid="72e41eeb99a44dde89e0c8530c4c3dbd">tempest-ServersNegativeTestJSON-2029109923-project-member</nova:user>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:project uuid="d989d010e8bf4fcabfc7f5109432fa29">tempest-ServersNegativeTestJSON-2029109923</nova:project>
Oct 26 09:30:40 user nova-compute[74075]:       </nova:owner>
Oct 26 09:30:40 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:30:40 user nova-compute[74075]:       <nova:ports>
Oct 26 09:30:40 user nova-compute[74075]:         <nova:port uuid="fa35f6a7-e07d-4fd1-9548-bf2a5bf40369">
Oct 26 09:30:40 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 09:30:40 user nova-compute[74075]:         </nova:port>
Oct 26 09:30:40 user nova-compute[74075]:       </nova:ports>
Oct 26 09:30:40 user nova-compute[74075]:     </nova:instance>
Oct 26 09:30:40 user nova-compute[74075]:   </metadata>
Oct 26 09:30:40 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:30:40 user nova-compute[74075]:     <system>
Oct 26 09:30:40 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:30:40 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:30:40 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:30:40 user nova-compute[74075]:       <entry name="serial">dd7a3ed2-b161-4950-bbcc-8de9c33e2275</entry>
Oct 26 09:30:40 user nova-compute[74075]:       <entry name="uuid">dd7a3ed2-b161-4950-bbcc-8de9c33e2275</entry>
Oct 26 09:30:40 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:30:40 user nova-compute[74075]:     </system>
Oct 26 09:30:40 user nova-compute[74075]:   </sysinfo>
Oct 26 09:30:40 user nova-compute[74075]:   <os>
Oct 26 09:30:40 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:30:40 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:30:40 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:30:40 user nova-compute[74075]:   </os>
Oct 26 09:30:40 user nova-compute[74075]:   <features>
Oct 26 09:30:40 user nova-compute[74075]:     <acpi/>
Oct 26 09:30:40 user nova-compute[74075]:     <apic/>
Oct 26 09:30:40 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:30:40 user nova-compute[74075]:   </features>
Oct 26 09:30:40 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:30:40 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:30:40 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:30:40 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:30:40 user nova-compute[74075]:   </clock>
Oct 26 09:30:40 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:30:40 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:30:40 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:30:40 user nova-compute[74075]:   </cpu>
Oct 26 09:30:40 user nova-compute[74075]:   <devices>
Oct 26 09:30:40 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:30:40 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:30:40 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk"/>
Oct 26 09:30:40 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:30:40 user nova-compute[74075]:     </disk>
Oct 26 09:30:40 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:30:40 user nova-compute[74075]:       <mac address="fa:16:3e:37:1f:3d"/>
Oct 26 09:30:40 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:30:40 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:30:40 user nova-compute[74075]:       <target dev="tapfa35f6a7-e0"/>
Oct 26 09:30:40 user nova-compute[74075]:     </interface>
Oct 26 09:30:40 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:30:40 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/console.log" append="off"/>
Oct 26 09:30:40 user nova-compute[74075]:     </serial>
Oct 26 09:30:40 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:30:40 user nova-compute[74075]:     <video>
Oct 26 09:30:40 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:30:40 user nova-compute[74075]:     </video>
Oct 26 09:30:40 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:30:40 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:30:40 user nova-compute[74075]:     </rng>
Oct 26 09:30:40 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:30:40 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:30:40 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:30:40 user nova-compute[74075]:     </memballoon>
Oct 26 09:30:40 user nova-compute[74075]:   </devices>
Oct 26 09:30:40 user nova-compute[74075]: </domain>
Oct 26 09:30:40 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1854875769',display_name='tempest-ServersNegativeTestJSON-server-1854875769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1854875769',id=13,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d989d010e8bf4fcabfc7f5109432fa29',ramdisk_id='',reservation_id='r-6nse3gb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2029109923',owner_user_name='tempest-ServersNegativeTestJSON-2029109923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:38Z,user_data=None,user_id='72e41eeb99a44dde89e0c8530c4c3dbd',uuid=dd7a3ed2-b161-4950-bbcc-8de9c33e2275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converting VIF {"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG os_vif [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '581fce74-7eef-5995-8653-14289dca741d', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa35f6a7-e0, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa35f6a7-e0, col_values=(('qos', UUID('16beefd6-2c18-442d-923f-9bc59ca8b004')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa35f6a7-e0, col_values=(('external_ids', {'iface-id': 'fa35f6a7-e07d-4fd1-9548-bf2a5bf40369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:1f:3d', 'vm-uuid': 'dd7a3ed2-b161-4950-bbcc-8de9c33e2275'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:40 user nova-compute[74075]: INFO os_vif [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0')
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] No VIF found with MAC fa:16:3e:37:1f:3d, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updated VIF entry in instance network info cache for port fa35f6a7-e07d-4fd1-9548-bf2a5bf40369. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updating instance_info_cache with network_info: [{"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-feffaca3-8977-48eb-81f3-3a39e37e57a5 req-b8a98b06-db0b-4c5f-9d64-125a6b67da5b service nova] Releasing lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-320325c8-1b3a-4ebc-bc68-e039b3ece945 req-e6ea2b6e-6aae-4104-9767-8b90b1a5717d service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-320325c8-1b3a-4ebc-bc68-e039b3ece945 req-e6ea2b6e-6aae-4104-9767-8b90b1a5717d service nova] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-320325c8-1b3a-4ebc-bc68-e039b3ece945 req-e6ea2b6e-6aae-4104-9767-8b90b1a5717d service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-320325c8-1b3a-4ebc-bc68-e039b3ece945 req-e6ea2b6e-6aae-4104-9767-8b90b1a5717d service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-320325c8-1b3a-4ebc-bc68-e039b3ece945 req-e6ea2b6e-6aae-4104-9767-8b90b1a5717d service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] No waiting events found dispatching network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:42 user nova-compute[74075]: WARNING nova.compute.manager [req-320325c8-1b3a-4ebc-bc68-e039b3ece945 req-e6ea2b6e-6aae-4104-9767-8b90b1a5717d service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received unexpected event network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 for instance with vm_state building and task_state spawning.
Oct 26 09:30:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:30:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Instance spawned successfully.
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-d6d96b02-2dbb-4fea-9ad9-d4c8e8f8effa req-4b34fb52-8d4a-4e65-bce3-ec74276481c1 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d6d96b02-2dbb-4fea-9ad9-d4c8e8f8effa req-4b34fb52-8d4a-4e65-bce3-ec74276481c1 service nova] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d6d96b02-2dbb-4fea-9ad9-d4c8e8f8effa req-4b34fb52-8d4a-4e65-bce3-ec74276481c1 service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d6d96b02-2dbb-4fea-9ad9-d4c8e8f8effa req-4b34fb52-8d4a-4e65-bce3-ec74276481c1 service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-d6d96b02-2dbb-4fea-9ad9-d4c8e8f8effa req-4b34fb52-8d4a-4e65-bce3-ec74276481c1 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] No waiting events found dispatching network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:44 user nova-compute[74075]: WARNING nova.compute.manager [req-d6d96b02-2dbb-4fea-9ad9-d4c8e8f8effa req-4b34fb52-8d4a-4e65-bce3-ec74276481c1 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received unexpected event network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 for instance with vm_state building and task_state spawning.
Oct 26 09:30:44 user nova-compute[74075]: INFO nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Took 6.04 seconds to spawn the instance on the hypervisor.
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:30:44 user nova-compute[74075]: INFO nova.compute.manager [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Took 6.94 seconds to build instance.
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cd001a03-ae9a-4f21-aa80-65e49a8d07db tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.047s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 5b47826e-624e-4045-b5bc-2b764caf3d25 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid dd7a3ed2-b161-4950-bbcc-8de9c33e2275 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "839ef064-055b-4050-9c92-8913891abfe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "839ef064-055b-4050-9c92-8913891abfe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:30:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:46 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:30:46 user nova-compute[74075]: INFO nova.compute.claims [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Claim successful on node user
Oct 26 09:30:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:30:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:30:47 user nova-compute[74075]: INFO nova.virt.block_device [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Booting with volume 6922b977-39aa-40c8-96e3-f722ccf6f275 at /dev/vda
Oct 26 09:30:47 user nova-compute[74075]: DEBUG os_brick.utils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292b449-6265-4622-bbb8-5c1d5254a43b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5553e306-ee22-4a9b-9e45-ed288192d7c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b665c2b-031b-45c3-a280-bc1d96658c4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d982822-0504-4e63-b674-b741e50e24db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:30:47 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:30:47 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d417868c-48b3-483b-a813-8c4d8c587601]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG os_brick.utils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating existing volume attachment record: 48265b54-2238-40f3-909e-e67940c8f178 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:30:47 user nova-compute[74075]: DEBUG nova.policy [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd20a1bbfb05446ea7d8784eddf7ae87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce8f02598ef4a1e9e6a82aaabf3c2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:30:49 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully created port: 709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:49 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully created port: a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:30:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully created port: c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:30:51 user nova-compute[74075]: INFO nova.compute.manager [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Unrescuing
Oct 26 09:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Skipping network cache update for instance because it is Building. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'flavor' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:30:51 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-a53f8e33-6b03-43cf-8330-a25b600b3a4b req-c57ac504-3288-49a9-9036-88cecba80a94 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a53f8e33-6b03-43cf-8330-a25b600b3a4b req-c57ac504-3288-49a9-9036-88cecba80a94 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a53f8e33-6b03-43cf-8330-a25b600b3a4b req-c57ac504-3288-49a9-9036-88cecba80a94 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a53f8e33-6b03-43cf-8330-a25b600b3a4b req-c57ac504-3288-49a9-9036-88cecba80a94 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-a53f8e33-6b03-43cf-8330-a25b600b3a4b req-c57ac504-3288-49a9-9036-88cecba80a94 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:52 user nova-compute[74075]: WARNING nova.compute.manager [req-a53f8e33-6b03-43cf-8330-a25b600b3a4b req-c57ac504-3288-49a9-9036-88cecba80a94 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:30:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully created port: c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:52 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance destroyed successfully.
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:30:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4baa273-79c9-408c-9c41-17e202582246 is timed out.
Oct 26 09:30:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully detached device vdb from instance e4baa273-79c9-408c-9c41-17e202582246 from the live domain config.
Oct 26 09:30:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHDQZzob', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:30:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b13a5-0b7f-459a-b92e-de5d0d5a8694]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:30:53 user nova-compute[74075]: No targets found.
Oct 26 09:30:53 user nova-compute[74075]: iSNS:
Oct 26 09:30:53 user nova-compute[74075]: No targets found.
Oct 26 09:30:53 user nova-compute[74075]: STATIC:
Oct 26 09:30:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d
Oct 26 09:30:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:30:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:30:53 user nova-compute[74075]: FIRMWARE:
Oct 26 09:30:53 user nova-compute[74075]: No targets found.
Oct 26 09:30:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:30:53 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:30:53 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edaf716-c66d-455c-8c6f-70430b7a5beb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c67be31-a2f5-48af-b9c4-ae1a9491a239]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:30:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d (non-flash)
Oct 26 09:30:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c146440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e1a73c-ef0c-4156-a3b5-8981843f19c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdecd90f-ef24-4904-bbd1-145c5314b681]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a306d5c4-d2d3-4fa5-a48c-8ffb45a7840c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb4d96e-d4f0-4e1f-ac52-5c24abff486a]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully created port: ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[22edc8fe-39b5-4471-b714-e72fa2f4d08c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[448fc908-73c7-4fd2-8c5c-36f5b77c16b9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260]
Oct 26 09:30:53 user nova-compute[74075]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d, portal: 172.16.0.220,3260] successful.
Oct 26 09:30:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8a0da-c8c6-41d9-b07b-9078aeeaf89d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a9096b-2dc8-4bcd-8cee-59e3668eba70]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== disconnect_volume: return (381ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:30:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc5230d7-93c0-44df-997a-2dc514f769ec req-88a721ad-b356-45cd-bac1-d362074781c8 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc5230d7-93c0-44df-997a-2dc514f769ec req-88a721ad-b356-45cd-bac1-d362074781c8 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc5230d7-93c0-44df-997a-2dc514f769ec req-88a721ad-b356-45cd-bac1-d362074781c8 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc5230d7-93c0-44df-997a-2dc514f769ec req-88a721ad-b356-45cd-bac1-d362074781c8 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc5230d7-93c0-44df-997a-2dc514f769ec req-88a721ad-b356-45cd-bac1-d362074781c8 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:54 user nova-compute[74075]: WARNING nova.compute.manager [req-cc5230d7-93c0-44df-997a-2dc514f769ec req-88a721ad-b356-45cd-bac1-d362074781c8 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:30:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:54 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: 709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-709d9d2f-c9de-4e69-b9c6-d201733cc02d. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port 709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a17c50f1-ab43-444b-aeee-bd9ba0ae8e91 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.370s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.241s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: 3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74075) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:30:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5e0c8729-b175-4b6e-857f-4649d24e0a23 req-3497abab-b54c-415a-a8b5-b0ebd43ca09a service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-17d9d7c8-c88d-43e3-b82f-9bf7fcea76bb req-67ca013b-567f-4fc9-99fb-c240128f606b service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-17d9d7c8-c88d-43e3-b82f-9bf7fcea76bb req-67ca013b-567f-4fc9-99fb-c240128f606b service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-17d9d7c8-c88d-43e3-b82f-9bf7fcea76bb req-67ca013b-567f-4fc9-99fb-c240128f606b service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-17d9d7c8-c88d-43e3-b82f-9bf7fcea76bb req-67ca013b-567f-4fc9-99fb-c240128f606b service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-17d9d7c8-c88d-43e3-b82f-9bf7fcea76bb req-67ca013b-567f-4fc9-99fb-c240128f606b service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:56 user nova-compute[74075]: WARNING nova.compute.manager [req-17d9d7c8-c88d-43e3-b82f-9bf7fcea76bb req-67ca013b-567f-4fc9-99fb-c240128f606b service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state active and task_state powering-off.
Oct 26 09:30:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:56 user nova-compute[74075]: WARNING nova.compute.manager [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:56 user nova-compute[74075]: WARNING nova.compute.manager [req-95b2a5f7-21bc-469a-80c5-3304cdc8bfeb req-53e42446-3ddc-4796-87ba-a71e5ca761b3 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:30:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance destroyed successfully.
Oct 26 09:30:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-71f194d9-11de-4cc8-8772-ecad7f09ab8c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.959s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6fc9b54e-893a-4c7a-b9d3-aac93cadabaa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: 28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-3f64d03b-372c-4542-b961-677277da707c. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port 3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-28abc9fa-723e-4cf8-9bcb-3bd8176a2652. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port 28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:30:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG nova.network.neutron [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG nova.network.neutron [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc26cbe6-8c49-4364-8f1f-3c239db781de req-b21b3f41-3d0d-48d2-8b7e-cdf4b7abbb36 service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-ed0d6d43-3036-4a64-ab8c-24f3b1c4ad5f req-173a90f8-a9fc-4450-ae61-fecb2bf5e299 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ed0d6d43-3036-4a64-ab8c-24f3b1c4ad5f req-173a90f8-a9fc-4450-ae61-fecb2bf5e299 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ed0d6d43-3036-4a64-ab8c-24f3b1c4ad5f req-173a90f8-a9fc-4450-ae61-fecb2bf5e299 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ed0d6d43-3036-4a64-ab8c-24f3b1c4ad5f req-173a90f8-a9fc-4450-ae61-fecb2bf5e299 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-ed0d6d43-3036-4a64-ab8c-24f3b1c4ad5f req-173a90f8-a9fc-4450-ae61-fecb2bf5e299 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:30:58 user nova-compute[74075]: WARNING nova.compute.manager [req-ed0d6d43-3036-4a64-ab8c-24f3b1c4ad5f req-173a90f8-a9fc-4450-ae61-fecb2bf5e299 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state stopped and task_state None.
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:30:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-a9e70323-2071-44ca-94d4-4bbffea7a52c. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.network.neutron [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:30:59 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:30:59 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7999MB free_disk=25.594741821289062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:30:59 user nova-compute[74075]: DEBUG nova.network.neutron [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 17b8e7c7-a424-4101-86eb-c62708543f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7732dc84-2261-4974-905f-ec1ac0add36f req-758630dd-bf88-4557-849e-0318cdccd58f service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f2a7059f-03e6-4aff-8e31-f04d2236a092 req-6a3a8db3-937c-4d65-bf8e-24b00423d6ce service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-c602d44f-e69e-45fc-819d-f42d44d4de72. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-629544e7-c056-4986-a764-2477a214365b req-ea873944-d51a-4e5c-887b-45565993241d service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Successfully updated port: ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:31:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:31:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:31:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-ecda9578-a8c4-44e5-8fd8-dde526552ba0. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:31:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [{"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance network_info: |[{"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updated VIF entry in instance network info cache for port ecda9578-a8c4-44e5-8fd8-dde526552ba0. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [{"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-919082cb-d763-4b1a-831c-bffaba3b4311 req-8a50b7ad-3740-42d3-9459-2d455933f38b service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:07 user nova-compute[74075]: INFO nova.compute.manager [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Terminating instance
Oct 26 09:31:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Instance destroyed successfully.
Oct 26 09:31:07 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lazy-loading 'resources' on Instance uuid 5b47826e-624e-4045-b5bc-2b764caf3d25 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1471145056',display_name='tempest-ServerStableDeviceRescueTest-server-1471145056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1471145056',id=3,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN+CPI+22HNzEUiu/bAeKJpY4WCCfNA62AUrMC4cMKsdV+f2WIRKP6BPAQPyltGs+73Xrt3TrglGfm4Iprdu21NYil7j8FSwmQKmpllJ2WKHmzIbUh6dHrhZXvzsnB+uw==',key_name='tempest-keypair-1180237628',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f470d22e854b1cb2b1f102504eb137',ramdisk_id='',reservation_id='r-21a3b6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-682475271',owner_user_name='tempest-ServerStableDeviceRescueTest-682475271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fb92f5c0c0147bdb439ef6456fc30a8',uuid=5b47826e-624e-4045-b5bc-2b764caf3d25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Converting VIF {"id": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "address": "fa:16:3e:89:99:4c", "network": {"id": "1a2be3df-7c51-49d2-a0c2-a1ec437c205e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962398202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f470d22e854b1cb2b1f102504eb137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f496fc-e8", "ovs_interfaceid": "48f496fc-e8b1-4065-b6a7-9c2e7512be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG os_vif [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48f496fc-e8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53c7b96c-a402-4c6d-862d-3d4f129a7124) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:07 user nova-compute[74075]: INFO os_vif [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:99:4c,bridge_name='br-int',has_traffic_filtering=True,id=48f496fc-e8b1-4065-b6a7-9c2e7512be56,network=Network(1a2be3df-7c51-49d2-a0c2-a1ec437c205e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f496fc-e8')
Oct 26 09:31:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Deleting instance files /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25_del
Oct 26 09:31:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Deletion of /opt/stack/data/nova/instances/5b47826e-624e-4045-b5bc-2b764caf3d25_del complete
Oct 26 09:31:08 user nova-compute[74075]: INFO nova.compute.manager [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Took 0.79 seconds to destroy the instance on the hypervisor.
Oct 26 09:31:08 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-1b39bd58-e6ba-4fa7-9057-19c5f6ee4468 req-b56cf648-d5ed-428c-8534-79ce448601fe service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-vif-unplugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1b39bd58-e6ba-4fa7-9057-19c5f6ee4468 req-b56cf648-d5ed-428c-8534-79ce448601fe service nova] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1b39bd58-e6ba-4fa7-9057-19c5f6ee4468 req-b56cf648-d5ed-428c-8534-79ce448601fe service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1b39bd58-e6ba-4fa7-9057-19c5f6ee4468 req-b56cf648-d5ed-428c-8534-79ce448601fe service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-1b39bd58-e6ba-4fa7-9057-19c5f6ee4468 req-b56cf648-d5ed-428c-8534-79ce448601fe service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] No waiting events found dispatching network-vif-unplugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-1b39bd58-e6ba-4fa7-9057-19c5f6ee4468 req-b56cf648-d5ed-428c-8534-79ce448601fe service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-vif-unplugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:08 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Took 0.84 seconds to deallocate network for instance.
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-2e091864-b620-4211-a959-491a18ba735b req-c2046b2e-0fdd-4bbb-8046-fe88cf6eb1ec service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-vif-deleted-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:08 user nova-compute[74075]: INFO nova.compute.manager [req-2e091864-b620-4211-a959-491a18ba735b req-c2046b2e-0fdd-4bbb-8046-fe88cf6eb1ec service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Neutron deleted interface 48f496fc-e8b1-4065-b6a7-9c2e7512be56; detaching it from the instance and deleting it from the info cache
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.network.neutron [req-2e091864-b620-4211-a959-491a18ba735b req-c2046b2e-0fdd-4bbb-8046-fe88cf6eb1ec service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-2e091864-b620-4211-a959-491a18ba735b req-c2046b2e-0fdd-4bbb-8046-fe88cf6eb1ec service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Detach interface failed, port_id=48f496fc-e8b1-4065-b6a7-9c2e7512be56, reason: Instance 5b47826e-624e-4045-b5bc-2b764caf3d25 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:09 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:31:09 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:31:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:09 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Deleted allocations for instance 5b47826e-624e-4045-b5bc-2b764caf3d25
Oct 26 09:31:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ba593475-6cec-44e9-8fc0-17c41835fb9e tempest-ServerStableDeviceRescueTest-682475271 tempest-ServerStableDeviceRescueTest-682475271-project-member] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-705409f4-1bcf-4718-a89f-0fcade0aba7a req-94b9e4ff-d2e3-42c8-aea9-8f532a5a8f96 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received event network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-705409f4-1bcf-4718-a89f-0fcade0aba7a req-94b9e4ff-d2e3-42c8-aea9-8f532a5a8f96 service nova] Acquiring lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-705409f4-1bcf-4718-a89f-0fcade0aba7a req-94b9e4ff-d2e3-42c8-aea9-8f532a5a8f96 service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-705409f4-1bcf-4718-a89f-0fcade0aba7a req-94b9e4ff-d2e3-42c8-aea9-8f532a5a8f96 service nova] Lock "5b47826e-624e-4045-b5bc-2b764caf3d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-705409f4-1bcf-4718-a89f-0fcade0aba7a req-94b9e4ff-d2e3-42c8-aea9-8f532a5a8f96 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] No waiting events found dispatching network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:10 user nova-compute[74075]: WARNING nova.compute.manager [req-705409f4-1bcf-4718-a89f-0fcade0aba7a req-94b9e4ff-d2e3-42c8-aea9-8f532a5a8f96 service nova] [instance: 5b47826e-624e-4045-b5bc-2b764caf3d25] Received unexpected event network-vif-plugged-48f496fc-e8b1-4065-b6a7-9c2e7512be56 for instance with vm_state deleted and task_state None.
Oct 26 09:31:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:31:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:31:13 user nova-compute[74075]: INFO nova.compute.claims [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Claim successful on node user
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:31:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.policy [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577f9cb60ea940e48405553a6ddc7c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c9daadd77642879f80a0233e0cb7fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:31:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Creating image(s)
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk 1073741824" returned: 0 in 0.071s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Successfully created port: 0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Cannot resize image /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Successfully updated port: 0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-changed-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Refreshing instance network info cache due to event network-changed-0f2ea36f-be05-482a-bd66-736c4d8b36f0. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:31:15 user nova-compute[74075]: INFO nova.compute.claims [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Claim successful on node user
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance network_info: |[{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Refreshing network info cache for port 0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start _get_guest_xml network_info=[{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:31:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:31:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'pci_devices' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:31:15 user nova-compute[74075]:   <uuid>b0ef0258-9bcd-4caa-822f-114e85431fb5</uuid>
Oct 26 09:31:15 user nova-compute[74075]:   <name>instance-0000000f</name>
Oct 26 09:31:15 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:31:15 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:31:15 user nova-compute[74075]:   <metadata>
Oct 26 09:31:15 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:31:15 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:31:15 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherB-server-1332623435</nova:name>
Oct 26 09:31:15 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:31:15</nova:creationTime>
Oct 26 09:31:15 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:31:15 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:31:15 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:31:15 user nova-compute[74075]:       <nova:owner>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:user uuid="577f9cb60ea940e48405553a6ddc7c18">tempest-ServerActionsTestOtherB-250783807-project-member</nova:user>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:project uuid="a8c9daadd77642879f80a0233e0cb7fa">tempest-ServerActionsTestOtherB-250783807</nova:project>
Oct 26 09:31:15 user nova-compute[74075]:       </nova:owner>
Oct 26 09:31:15 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:31:15 user nova-compute[74075]:       <nova:ports>
Oct 26 09:31:15 user nova-compute[74075]:         <nova:port uuid="0f2ea36f-be05-482a-bd66-736c4d8b36f0">
Oct 26 09:31:15 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:31:15 user nova-compute[74075]:         </nova:port>
Oct 26 09:31:15 user nova-compute[74075]:       </nova:ports>
Oct 26 09:31:15 user nova-compute[74075]:     </nova:instance>
Oct 26 09:31:15 user nova-compute[74075]:   </metadata>
Oct 26 09:31:15 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:31:15 user nova-compute[74075]:     <system>
Oct 26 09:31:15 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:31:15 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:31:15 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:31:15 user nova-compute[74075]:       <entry name="serial">b0ef0258-9bcd-4caa-822f-114e85431fb5</entry>
Oct 26 09:31:15 user nova-compute[74075]:       <entry name="uuid">b0ef0258-9bcd-4caa-822f-114e85431fb5</entry>
Oct 26 09:31:15 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:31:15 user nova-compute[74075]:     </system>
Oct 26 09:31:15 user nova-compute[74075]:   </sysinfo>
Oct 26 09:31:15 user nova-compute[74075]:   <os>
Oct 26 09:31:15 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:31:15 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:31:15 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:31:15 user nova-compute[74075]:   </os>
Oct 26 09:31:15 user nova-compute[74075]:   <features>
Oct 26 09:31:15 user nova-compute[74075]:     <acpi/>
Oct 26 09:31:15 user nova-compute[74075]:     <apic/>
Oct 26 09:31:15 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:31:15 user nova-compute[74075]:   </features>
Oct 26 09:31:15 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:31:15 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:31:15 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:31:15 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:31:15 user nova-compute[74075]:   </clock>
Oct 26 09:31:15 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:31:15 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:31:15 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:31:15 user nova-compute[74075]:   </cpu>
Oct 26 09:31:15 user nova-compute[74075]:   <devices>
Oct 26 09:31:15 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:31:15 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:31:15 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk"/>
Oct 26 09:31:15 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:31:15 user nova-compute[74075]:     </disk>
Oct 26 09:31:15 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:31:15 user nova-compute[74075]:       <mac address="fa:16:3e:7d:66:e0"/>
Oct 26 09:31:15 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:31:15 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:31:15 user nova-compute[74075]:       <target dev="tap0f2ea36f-be"/>
Oct 26 09:31:15 user nova-compute[74075]:     </interface>
Oct 26 09:31:15 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:31:15 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/console.log" append="off"/>
Oct 26 09:31:15 user nova-compute[74075]:     </serial>
Oct 26 09:31:15 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:31:15 user nova-compute[74075]:     <video>
Oct 26 09:31:15 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:31:15 user nova-compute[74075]:     </video>
Oct 26 09:31:15 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:31:15 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:31:15 user nova-compute[74075]:     </rng>
Oct 26 09:31:15 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:31:15 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:31:15 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:31:15 user nova-compute[74075]:     </memballoon>
Oct 26 09:31:15 user nova-compute[74075]:   </devices>
Oct 26 09:31:15 user nova-compute[74075]: </domain>
Oct 26 09:31:15 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG os_vif [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '812f6361-a863-5944-baeb-cb5cf941cd1e', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f2ea36f-be, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f2ea36f-be, col_values=(('qos', UUID('58bd9d1f-afe3-4e11-8f02-0927743f2720')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f2ea36f-be, col_values=(('external_ids', {'iface-id': '0f2ea36f-be05-482a-bd66-736c4d8b36f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:66:e0', 'vm-uuid': 'b0ef0258-9bcd-4caa-822f-114e85431fb5'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:15 user nova-compute[74075]: INFO os_vif [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be')
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No VIF found with MAC fa:16:3e:7d:66:e0, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:31:15 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.policy [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '729f5d24fc714c65b3c1a811e5cdf271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a627b8e169d4a97b075f16e150d972f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:31:15 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Creating image(s)
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "/opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "/opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "/opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updated VIF entry in instance network info cache for port 0f2ea36f-be05-482a-bd66-736c4d8b36f0. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b591271e-3e5a-46fb-9e49-162edc93c149 req-1913e89c-72b0-47e3-8e7c-e2e4f1c7e7c2 service nova] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk 1073741824" returned: 0 in 0.133s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Successfully created port: 98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Cannot resize image /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Ensure instance console log exists: /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Successfully updated port: 98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-changed-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Refreshing instance network info cache due to event network-changed-98e149e6-16b9-4b73-b3cb-8db9085814c6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Instance network_info: |[{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Refreshing network info cache for port 98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Start _get_guest_xml network_info=[{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:31:17 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:31:17 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1140677712',display_name='tempest-ServerActionsTestOtherA-server-1140677712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1140677712',id=16,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-790sm4hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=58346cfe-b396-4dbf-9a7a-b166f73fdb0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'pci_devices' on Instance uuid 58346cfe-b396-4dbf-9a7a-b166f73fdb0e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:31:17 user nova-compute[74075]:   <uuid>58346cfe-b396-4dbf-9a7a-b166f73fdb0e</uuid>
Oct 26 09:31:17 user nova-compute[74075]:   <name>instance-00000010</name>
Oct 26 09:31:17 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:31:17 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:31:17 user nova-compute[74075]:   <metadata>
Oct 26 09:31:17 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:31:17 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:31:17 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherA-server-1140677712</nova:name>
Oct 26 09:31:17 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:31:17</nova:creationTime>
Oct 26 09:31:17 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:31:17 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:31:17 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:31:17 user nova-compute[74075]:       <nova:owner>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:user uuid="729f5d24fc714c65b3c1a811e5cdf271">tempest-ServerActionsTestOtherA-546437878-project-member</nova:user>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:project uuid="7a627b8e169d4a97b075f16e150d972f">tempest-ServerActionsTestOtherA-546437878</nova:project>
Oct 26 09:31:17 user nova-compute[74075]:       </nova:owner>
Oct 26 09:31:17 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:31:17 user nova-compute[74075]:       <nova:ports>
Oct 26 09:31:17 user nova-compute[74075]:         <nova:port uuid="98e149e6-16b9-4b73-b3cb-8db9085814c6">
Oct 26 09:31:17 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 09:31:17 user nova-compute[74075]:         </nova:port>
Oct 26 09:31:17 user nova-compute[74075]:       </nova:ports>
Oct 26 09:31:17 user nova-compute[74075]:     </nova:instance>
Oct 26 09:31:17 user nova-compute[74075]:   </metadata>
Oct 26 09:31:17 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:31:17 user nova-compute[74075]:     <system>
Oct 26 09:31:17 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:31:17 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:31:17 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:31:17 user nova-compute[74075]:       <entry name="serial">58346cfe-b396-4dbf-9a7a-b166f73fdb0e</entry>
Oct 26 09:31:17 user nova-compute[74075]:       <entry name="uuid">58346cfe-b396-4dbf-9a7a-b166f73fdb0e</entry>
Oct 26 09:31:17 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:31:17 user nova-compute[74075]:     </system>
Oct 26 09:31:17 user nova-compute[74075]:   </sysinfo>
Oct 26 09:31:17 user nova-compute[74075]:   <os>
Oct 26 09:31:17 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:31:17 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:31:17 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:31:17 user nova-compute[74075]:   </os>
Oct 26 09:31:17 user nova-compute[74075]:   <features>
Oct 26 09:31:17 user nova-compute[74075]:     <acpi/>
Oct 26 09:31:17 user nova-compute[74075]:     <apic/>
Oct 26 09:31:17 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:31:17 user nova-compute[74075]:   </features>
Oct 26 09:31:17 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:31:17 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:31:17 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:31:17 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:31:17 user nova-compute[74075]:   </clock>
Oct 26 09:31:17 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:31:17 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:31:17 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:31:17 user nova-compute[74075]:   </cpu>
Oct 26 09:31:17 user nova-compute[74075]:   <devices>
Oct 26 09:31:17 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:31:17 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:31:17 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk"/>
Oct 26 09:31:17 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:31:17 user nova-compute[74075]:     </disk>
Oct 26 09:31:17 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:31:17 user nova-compute[74075]:       <mac address="fa:16:3e:a4:d5:22"/>
Oct 26 09:31:17 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:31:17 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:31:17 user nova-compute[74075]:       <target dev="tap98e149e6-16"/>
Oct 26 09:31:17 user nova-compute[74075]:     </interface>
Oct 26 09:31:17 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:31:17 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/console.log" append="off"/>
Oct 26 09:31:17 user nova-compute[74075]:     </serial>
Oct 26 09:31:17 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:31:17 user nova-compute[74075]:     <video>
Oct 26 09:31:17 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:31:17 user nova-compute[74075]:     </video>
Oct 26 09:31:17 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:31:17 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:31:17 user nova-compute[74075]:     </rng>
Oct 26 09:31:17 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:31:17 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:31:17 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:31:17 user nova-compute[74075]:     </memballoon>
Oct 26 09:31:17 user nova-compute[74075]:   </devices>
Oct 26 09:31:17 user nova-compute[74075]: </domain>
Oct 26 09:31:17 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1140677712',display_name='tempest-ServerActionsTestOtherA-server-1140677712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1140677712',id=16,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-790sm4hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=58346cfe-b396-4dbf-9a7a-b166f73fdb0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG os_vif [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3332af84-9a2b-5547-acd4-712c98bad308', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98e149e6-16, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98e149e6-16, col_values=(('qos', UUID('d2e85d2c-f225-4a20-b8cf-483fe927fc12')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98e149e6-16, col_values=(('external_ids', {'iface-id': '98e149e6-16b9-4b73-b3cb-8db9085814c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:d5:22', 'vm-uuid': '58346cfe-b396-4dbf-9a7a-b166f73fdb0e'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: INFO os_vif [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16')
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No VIF found with MAC fa:16:3e:a4:d5:22, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updated VIF entry in instance network info cache for port 98e149e6-16b9-4b73-b3cb-8db9085814c6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG nova.network.neutron [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a633a976-5971-4847-9596-082a87040f15 req-a5d3e4bd-9420-4eb3-a207-b4a4ec5a96ed service nova] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:31:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance spawned successfully.
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:19 user nova-compute[74075]: INFO nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Took 5.84 seconds to spawn the instance on the hypervisor.
Oct 26 09:31:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:31:19 user nova-compute[74075]: INFO nova.compute.manager [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Took 6.59 seconds to build instance.
Oct 26 09:31:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b3c02956-6ad8-40ab-bf93-3b6f2f64e2e5 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.698s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-4f31ff9a-9e3f-47cc-ae02-de1a445172ef req-a2c30f10-78dc-48cb-8abe-d7b70499a564 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4f31ff9a-9e3f-47cc-ae02-de1a445172ef req-a2c30f10-78dc-48cb-8abe-d7b70499a564 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4f31ff9a-9e3f-47cc-ae02-de1a445172ef req-a2c30f10-78dc-48cb-8abe-d7b70499a564 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4f31ff9a-9e3f-47cc-ae02-de1a445172ef req-a2c30f10-78dc-48cb-8abe-d7b70499a564 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-4f31ff9a-9e3f-47cc-ae02-de1a445172ef req-a2c30f10-78dc-48cb-8abe-d7b70499a564 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:20 user nova-compute[74075]: WARNING nova.compute.manager [req-4f31ff9a-9e3f-47cc-ae02-de1a445172ef req-a2c30f10-78dc-48cb-8abe-d7b70499a564 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state None.
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:31:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Instance spawned successfully.
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:31:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:21 user nova-compute[74075]: INFO nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Took 5.80 seconds to spawn the instance on the hypervisor.
Oct 26 09:31:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:31:21 user nova-compute[74075]: INFO nova.compute.manager [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Took 6.63 seconds to build instance.
Oct 26 09:31:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f8cc5e30-ceda-4d06-bd5f-3ee740d2f5b8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.754s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:22 user nova-compute[74075]: WARNING nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state None.
Oct 26 09:31:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] No waiting events found dispatching network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:22 user nova-compute[74075]: WARNING nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received unexpected event network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 for instance with vm_state active and task_state None.
Oct 26 09:31:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] No waiting events found dispatching network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:22 user nova-compute[74075]: WARNING nova.compute.manager [req-4767dfcb-82b5-439c-8ad8-3caf78a91a8b req-06b67d58-e7cd-4907-b22d-d1661e927aa8 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received unexpected event network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 for instance with vm_state active and task_state None.
Oct 26 09:31:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:48 user nova-compute[74075]: INFO nova.compute.manager [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Terminating instance
Oct 26 09:31:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-b360860f-2904-4b4e-bc66-12aafd467b3d req-39a737ca-06fa-47df-9542-c4550a14e595 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-vif-unplugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b360860f-2904-4b4e-bc66-12aafd467b3d req-39a737ca-06fa-47df-9542-c4550a14e595 service nova] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b360860f-2904-4b4e-bc66-12aafd467b3d req-39a737ca-06fa-47df-9542-c4550a14e595 service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b360860f-2904-4b4e-bc66-12aafd467b3d req-39a737ca-06fa-47df-9542-c4550a14e595 service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-b360860f-2904-4b4e-bc66-12aafd467b3d req-39a737ca-06fa-47df-9542-c4550a14e595 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] No waiting events found dispatching network-vif-unplugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-b360860f-2904-4b4e-bc66-12aafd467b3d req-39a737ca-06fa-47df-9542-c4550a14e595 service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-vif-unplugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:31:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Instance destroyed successfully.
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lazy-loading 'resources' on Instance uuid 17b8e7c7-a424-4101-86eb-c62708543f06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1765329378',display_name='tempest-VolumesAdminNegativeTest-server-1765329378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1765329378',id=5,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIg0UrD9IUlnMUY4/40eum5PCLSTy/5gxF1H+FCVBEkxUmFBVsrL71Ec1NZXF6DUOwUZAhw7edf2fxVTg6qXvH2wvyKm6CsIXDrZk9aGJOO9I/MjZglqkXQqG8VPW3j0Q==',key_name='tempest-keypair-53060570',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f45c95858d242088d115e4e062f1c55',ramdisk_id='',reservation_id='r-gmci10gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1450530067',owner_user_name='tempest-VolumesAdminNegativeTest-1450530067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1003917645d47fa97204a5120eccadf',uuid=17b8e7c7-a424-4101-86eb-c62708543f06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converting VIF {"id": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "address": "fa:16:3e:b3:a0:77", "network": {"id": "75f17dd6-7d3f-4276-84d6-359adb664644", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1987731501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f45c95858d242088d115e4e062f1c55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82c639c-eb", "ovs_interfaceid": "c82c639c-ebc3-4b59-926b-f5e1ae424576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG os_vif [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc82c639c-eb, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=086908ac-26d8-4259-b9ba-dd91ab5a4efb) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:49 user nova-compute[74075]: INFO os_vif [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a0:77,bridge_name='br-int',has_traffic_filtering=True,id=c82c639c-ebc3-4b59-926b-f5e1ae424576,network=Network(75f17dd6-7d3f-4276-84d6-359adb664644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82c639c-eb')
Oct 26 09:31:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Deleting instance files /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06_del
Oct 26 09:31:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Deletion of /opt/stack/data/nova/instances/17b8e7c7-a424-4101-86eb-c62708543f06_del complete
Oct 26 09:31:49 user nova-compute[74075]: INFO nova.compute.manager [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 26 09:31:49 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:31:49 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:31:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:31:50 user nova-compute[74075]: INFO nova.compute.manager [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] instance snapshotting
Oct 26 09:31:50 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Beginning live snapshot process
Oct 26 09:31:50 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:50 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Took 1.07 seconds to deallocate network for instance.
Oct 26 09:31:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-c3c51639-e816-42ff-a131-daeca870158c req-231869ce-f3bb-477b-aa7a-d389fc08a15c service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-vif-deleted-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:50 user nova-compute[74075]: INFO nova.compute.manager [req-c3c51639-e816-42ff-a131-daeca870158c req-231869ce-f3bb-477b-aa7a-d389fc08a15c service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Neutron deleted interface c82c639c-ebc3-4b59-926b-f5e1ae424576; detaching it from the instance and deleting it from the info cache
Oct 26 09:31:50 user nova-compute[74075]: DEBUG nova.network.neutron [req-c3c51639-e816-42ff-a131-daeca870158c req-231869ce-f3bb-477b-aa7a-d389fc08a15c service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-c3c51639-e816-42ff-a131-daeca870158c req-231869ce-f3bb-477b-aa7a-d389fc08a15c service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Detach interface failed, port_id=c82c639c-ebc3-4b59-926b-f5e1ae424576, reason: Instance 17b8e7c7-a424-4101-86eb-c62708543f06 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:31:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-abe8ade2-e503-4caf-a7b2-0d9ae8b7d3cf req-025ee0a1-949b-4cfd-938b-30887a483afc service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received event network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-abe8ade2-e503-4caf-a7b2-0d9ae8b7d3cf req-025ee0a1-949b-4cfd-938b-30887a483afc service nova] Acquiring lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-abe8ade2-e503-4caf-a7b2-0d9ae8b7d3cf req-025ee0a1-949b-4cfd-938b-30887a483afc service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-abe8ade2-e503-4caf-a7b2-0d9ae8b7d3cf req-025ee0a1-949b-4cfd-938b-30887a483afc service nova] Lock "17b8e7c7-a424-4101-86eb-c62708543f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-abe8ade2-e503-4caf-a7b2-0d9ae8b7d3cf req-025ee0a1-949b-4cfd-938b-30887a483afc service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] No waiting events found dispatching network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:31:51 user nova-compute[74075]: WARNING nova.compute.manager [req-abe8ade2-e503-4caf-a7b2-0d9ae8b7d3cf req-025ee0a1-949b-4cfd-938b-30887a483afc service nova] [instance: 17b8e7c7-a424-4101-86eb-c62708543f06] Received unexpected event network-vif-plugged-c82c639c-ebc3-4b59-926b-f5e1ae424576 for instance with vm_state deleted and task_state None.
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json -f qcow2" returned: 0 in 0.281s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:51 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Deleted allocations for instance 17b8e7c7-a424-4101-86eb-c62708543f06
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d01ad7d6-7936-4738-bc6f-615eef0db148 tempest-VolumesAdminNegativeTest-1450530067 tempest-VolumesAdminNegativeTest-1450530067-project-member] Lock "17b8e7c7-a424-4101-86eb-c62708543f06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg0w75v6l/818cee84ef844a34a2fccd7ae4b82f6e.delta 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg0w75v6l/818cee84ef844a34a2fccd7ae4b82f6e.delta 1073741824" returned: 0 in 0.059s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:31:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:31:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] COPY block job progress, current cursor: 48889856 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:31:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:31:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 09:31:53 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:31:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg0w75v6l/818cee84ef844a34a2fccd7ae4b82f6e.delta /opt/stack/data/nova/instances/snapshots/tmpg0w75v6l/818cee84ef844a34a2fccd7ae4b82f6e {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg0w75v6l/818cee84ef844a34a2fccd7ae4b82f6e.delta /opt/stack/data/nova/instances/snapshots/tmpg0w75v6l/818cee84ef844a34a2fccd7ae4b82f6e" returned: 0 in 0.468s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:54 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Snapshot extracted, beginning image upload
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Snapshot image upload complete
Oct 26 09:31:56 user nova-compute[74075]: INFO nova.compute.manager [None req-f60b052a-a8e3-4698-aad4-64fef1370c96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Took 6.05 seconds to snapshot the instance on the hypervisor.
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:57 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:31:57 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7829MB free_disk=25.542938232421875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:31:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:31:58 user nova-compute[74075]: INFO nova.virt.block_device [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Booting with volume b9d429dd-394a-43d1-94ad-48a5feff4663 at /dev/vdb
Oct 26 09:31:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ee6bfd-30c4-46e5-ae87-2182b16b348d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[44be531e-2123-4542-bf13-03bbbedb8b27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacb6e45-5294-4211-9c4d-a4441fbd7c13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d59a83-d398-4e75-8f70-e116551ff3d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:31:58 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:31:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c42048f-26b2-4c41-85de-c4aa766c45eb]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:31:58 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating existing volume attachment record: 85c866c0-cd42-46a8-9fb9-b93228ba8998 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:31:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:31:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:31:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:32:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:32:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:32:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:32:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:32:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:32:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:32:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:32:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:32:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:32:29 user nova-compute[74075]: INFO nova.compute.claims [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Claim successful on node user
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:32:29 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.policy [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72e41eeb99a44dde89e0c8530c4c3dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd989d010e8bf4fcabfc7f5109432fa29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:32:29 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Creating image(s)
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "/opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "/opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk 1073741824" returned: 0 in 0.053s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Successfully created port: bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Cannot resize image /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Ensure instance console log exists: /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Successfully updated port: bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "refresh_cache-dc06e7b9-860e-4ba3-8918-9b2f9dc21856" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquired lock "refresh_cache-dc06e7b9-860e-4ba3-8918-9b2f9dc21856" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-changed-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Refreshing instance network info cache due to event network-changed-bf16784b-a487-416e-ab92-00e783953c22. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] Acquiring lock "refresh_cache-dc06e7b9-860e-4ba3-8918-9b2f9dc21856" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Updating instance_info_cache with network_info: [{"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Releasing lock "refresh_cache-dc06e7b9-860e-4ba3-8918-9b2f9dc21856" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Instance network_info: |[{"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] Acquired lock "refresh_cache-dc06e7b9-860e-4ba3-8918-9b2f9dc21856" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Refreshing network info cache for port bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Start _get_guest_xml network_info=[{"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:32:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1329854133',display_name='tempest-ServersNegativeTestJSON-server-1329854133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1329854133',id=17,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d989d010e8bf4fcabfc7f5109432fa29',ramdisk_id='',reservation_id='r-04dra1nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2029109923',owner_user_name='tempest-ServersNegativeTestJSON-2029109923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:32:30Z,user_data=None,user_id='72e41eeb99a44dde89e0c8530c4c3dbd',uuid=dc06e7b9-860e-4ba3-8918-9b2f9dc21856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converting VIF {"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lazy-loading 'pci_devices' on Instance uuid dc06e7b9-860e-4ba3-8918-9b2f9dc21856 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:32:31 user nova-compute[74075]:   <uuid>dc06e7b9-860e-4ba3-8918-9b2f9dc21856</uuid>
Oct 26 09:32:31 user nova-compute[74075]:   <name>instance-00000011</name>
Oct 26 09:32:31 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:32:31 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:32:31 user nova-compute[74075]:   <metadata>
Oct 26 09:32:31 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:32:31 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:32:31 user nova-compute[74075]:       <nova:name>tempest-ServersNegativeTestJSON-server-1329854133</nova:name>
Oct 26 09:32:31 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:32:31</nova:creationTime>
Oct 26 09:32:31 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:32:31 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:32:31 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:32:31 user nova-compute[74075]:       <nova:owner>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:user uuid="72e41eeb99a44dde89e0c8530c4c3dbd">tempest-ServersNegativeTestJSON-2029109923-project-member</nova:user>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:project uuid="d989d010e8bf4fcabfc7f5109432fa29">tempest-ServersNegativeTestJSON-2029109923</nova:project>
Oct 26 09:32:31 user nova-compute[74075]:       </nova:owner>
Oct 26 09:32:31 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:32:31 user nova-compute[74075]:       <nova:ports>
Oct 26 09:32:31 user nova-compute[74075]:         <nova:port uuid="bf16784b-a487-416e-ab92-00e783953c22">
Oct 26 09:32:31 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 09:32:31 user nova-compute[74075]:         </nova:port>
Oct 26 09:32:31 user nova-compute[74075]:       </nova:ports>
Oct 26 09:32:31 user nova-compute[74075]:     </nova:instance>
Oct 26 09:32:31 user nova-compute[74075]:   </metadata>
Oct 26 09:32:31 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:32:31 user nova-compute[74075]:     <system>
Oct 26 09:32:31 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:32:31 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:32:31 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:32:31 user nova-compute[74075]:       <entry name="serial">dc06e7b9-860e-4ba3-8918-9b2f9dc21856</entry>
Oct 26 09:32:31 user nova-compute[74075]:       <entry name="uuid">dc06e7b9-860e-4ba3-8918-9b2f9dc21856</entry>
Oct 26 09:32:31 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:32:31 user nova-compute[74075]:     </system>
Oct 26 09:32:31 user nova-compute[74075]:   </sysinfo>
Oct 26 09:32:31 user nova-compute[74075]:   <os>
Oct 26 09:32:31 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:32:31 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:32:31 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:32:31 user nova-compute[74075]:   </os>
Oct 26 09:32:31 user nova-compute[74075]:   <features>
Oct 26 09:32:31 user nova-compute[74075]:     <acpi/>
Oct 26 09:32:31 user nova-compute[74075]:     <apic/>
Oct 26 09:32:31 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:32:31 user nova-compute[74075]:   </features>
Oct 26 09:32:31 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:32:31 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:32:31 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:32:31 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:32:31 user nova-compute[74075]:   </clock>
Oct 26 09:32:31 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:32:31 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:32:31 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:32:31 user nova-compute[74075]:   </cpu>
Oct 26 09:32:31 user nova-compute[74075]:   <devices>
Oct 26 09:32:31 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:32:31 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:32:31 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk"/>
Oct 26 09:32:31 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:32:31 user nova-compute[74075]:     </disk>
Oct 26 09:32:31 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:32:31 user nova-compute[74075]:       <mac address="fa:16:3e:57:22:8b"/>
Oct 26 09:32:31 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:31 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:32:31 user nova-compute[74075]:       <target dev="tapbf16784b-a4"/>
Oct 26 09:32:31 user nova-compute[74075]:     </interface>
Oct 26 09:32:31 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:32:31 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/console.log" append="off"/>
Oct 26 09:32:31 user nova-compute[74075]:     </serial>
Oct 26 09:32:31 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:32:31 user nova-compute[74075]:     <video>
Oct 26 09:32:31 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:31 user nova-compute[74075]:     </video>
Oct 26 09:32:31 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:32:31 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:32:31 user nova-compute[74075]:     </rng>
Oct 26 09:32:31 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:32:31 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:32:31 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:32:31 user nova-compute[74075]:     </memballoon>
Oct 26 09:32:31 user nova-compute[74075]:   </devices>
Oct 26 09:32:31 user nova-compute[74075]: </domain>
Oct 26 09:32:31 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1329854133',display_name='tempest-ServersNegativeTestJSON-server-1329854133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1329854133',id=17,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d989d010e8bf4fcabfc7f5109432fa29',ramdisk_id='',reservation_id='r-04dra1nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2029109923',owner_user_name='tempest-ServersNegativeTestJSON-2029109923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:32:30Z,user_data=None,user_id='72e41eeb99a44dde89e0c8530c4c3dbd',uuid=dc06e7b9-860e-4ba3-8918-9b2f9dc21856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converting VIF {"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG os_vif [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da91c32b-5d73-516f-be6e-f1b538506966', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf16784b-a4, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf16784b-a4, col_values=(('qos', UUID('a793336b-d734-49ca-a4af-57d572dbb657')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf16784b-a4, col_values=(('external_ids', {'iface-id': 'bf16784b-a487-416e-ab92-00e783953c22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:22:8b', 'vm-uuid': 'dc06e7b9-860e-4ba3-8918-9b2f9dc21856'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:31 user nova-compute[74075]: INFO os_vif [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4')
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] No VIF found with MAC fa:16:3e:57:22:8b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Updated VIF entry in instance network info cache for port bf16784b-a487-416e-ab92-00e783953c22. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG nova.network.neutron [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Updating instance_info_cache with network_info: [{"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bbd8e057-953c-47b5-9f4e-8d457a4d100c req-df66e3a1-a4d3-417d-a697-37ffb6f88615 service nova] Releasing lock "refresh_cache-dc06e7b9-860e-4ba3-8918-9b2f9dc21856" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-32ab0900-7fa5-4a94-a203-e244a2271196 req-d0a01aaf-18fc-4290-a0cf-28d6dc46e636 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-32ab0900-7fa5-4a94-a203-e244a2271196 req-d0a01aaf-18fc-4290-a0cf-28d6dc46e636 service nova] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-32ab0900-7fa5-4a94-a203-e244a2271196 req-d0a01aaf-18fc-4290-a0cf-28d6dc46e636 service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-32ab0900-7fa5-4a94-a203-e244a2271196 req-d0a01aaf-18fc-4290-a0cf-28d6dc46e636 service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-32ab0900-7fa5-4a94-a203-e244a2271196 req-d0a01aaf-18fc-4290-a0cf-28d6dc46e636 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] No waiting events found dispatching network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:33 user nova-compute[74075]: WARNING nova.compute.manager [req-32ab0900-7fa5-4a94-a203-e244a2271196 req-d0a01aaf-18fc-4290-a0cf-28d6dc46e636 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received unexpected event network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 for instance with vm_state building and task_state spawning.
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:32:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Instance spawned successfully.
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:32:35 user nova-compute[74075]: INFO nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Took 5.49 seconds to spawn the instance on the hypervisor.
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:32:35 user nova-compute[74075]: INFO nova.compute.manager [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Took 6.36 seconds to build instance.
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-b23da071-ccd7-453d-91e5-3c32159d2c07 req-e4e67f6b-9b79-4123-9e08-4e140d94103e service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b23da071-ccd7-453d-91e5-3c32159d2c07 req-e4e67f6b-9b79-4123-9e08-4e140d94103e service nova] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b23da071-ccd7-453d-91e5-3c32159d2c07 req-e4e67f6b-9b79-4123-9e08-4e140d94103e service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b23da071-ccd7-453d-91e5-3c32159d2c07 req-e4e67f6b-9b79-4123-9e08-4e140d94103e service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-b23da071-ccd7-453d-91e5-3c32159d2c07 req-e4e67f6b-9b79-4123-9e08-4e140d94103e service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] No waiting events found dispatching network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:35 user nova-compute[74075]: WARNING nova.compute.manager [req-b23da071-ccd7-453d-91e5-3c32159d2c07 req-e4e67f6b-9b79-4123-9e08-4e140d94103e service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received unexpected event network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 for instance with vm_state active and task_state None.
Oct 26 09:32:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a99256ea-eca5-421b-8cdc-392d212b721f tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.480s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'info_cache' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:46 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance destroyed successfully.
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'resources' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:30:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG os_vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbf845ec-94, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16f2ae27-7113-4051-9938-f90cc67caaaf) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:47 user nova-compute[74075]: INFO os_vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94')
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start _get_guest_xml network_info=[{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'numa_topology' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:47 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:47 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:30:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'pci_devices' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:32:47 user nova-compute[74075]:   <uuid>e4baa273-79c9-408c-9c41-17e202582246</uuid>
Oct 26 09:32:47 user nova-compute[74075]:   <name>instance-00000004</name>
Oct 26 09:32:47 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:32:47 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:32:47 user nova-compute[74075]:   <metadata>
Oct 26 09:32:47 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:32:47 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:32:47 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeTestJSON-server-650728468</nova:name>
Oct 26 09:32:47 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:32:47</nova:creationTime>
Oct 26 09:32:47 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:32:47 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:32:47 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:32:47 user nova-compute[74075]:       <nova:owner>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:user uuid="454822c8719441388cd38cd86b736b3c">tempest-AttachVolumeTestJSON-1598575575-project-member</nova:user>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:project uuid="4c09f49b38ff4e4f96fa233d1c8e33f4">tempest-AttachVolumeTestJSON-1598575575</nova:project>
Oct 26 09:32:47 user nova-compute[74075]:       </nova:owner>
Oct 26 09:32:47 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:32:47 user nova-compute[74075]:       <nova:ports>
Oct 26 09:32:47 user nova-compute[74075]:         <nova:port uuid="bbf845ec-94f6-4489-a12d-2bc5cca19e8a">
Oct 26 09:32:47 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:32:47 user nova-compute[74075]:         </nova:port>
Oct 26 09:32:47 user nova-compute[74075]:       </nova:ports>
Oct 26 09:32:47 user nova-compute[74075]:     </nova:instance>
Oct 26 09:32:47 user nova-compute[74075]:   </metadata>
Oct 26 09:32:47 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:32:47 user nova-compute[74075]:     <system>
Oct 26 09:32:47 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:32:47 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:32:47 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:32:47 user nova-compute[74075]:       <entry name="serial">e4baa273-79c9-408c-9c41-17e202582246</entry>
Oct 26 09:32:47 user nova-compute[74075]:       <entry name="uuid">e4baa273-79c9-408c-9c41-17e202582246</entry>
Oct 26 09:32:47 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:32:47 user nova-compute[74075]:     </system>
Oct 26 09:32:47 user nova-compute[74075]:   </sysinfo>
Oct 26 09:32:47 user nova-compute[74075]:   <os>
Oct 26 09:32:47 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:32:47 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:32:47 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:32:47 user nova-compute[74075]:   </os>
Oct 26 09:32:47 user nova-compute[74075]:   <features>
Oct 26 09:32:47 user nova-compute[74075]:     <acpi/>
Oct 26 09:32:47 user nova-compute[74075]:     <apic/>
Oct 26 09:32:47 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:32:47 user nova-compute[74075]:   </features>
Oct 26 09:32:47 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:32:47 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:32:47 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:32:47 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:32:47 user nova-compute[74075]:   </clock>
Oct 26 09:32:47 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:32:47 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:32:47 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:32:47 user nova-compute[74075]:   </cpu>
Oct 26 09:32:47 user nova-compute[74075]:   <devices>
Oct 26 09:32:47 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:32:47 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:32:47 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk"/>
Oct 26 09:32:47 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:32:47 user nova-compute[74075]:     </disk>
Oct 26 09:32:47 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:32:47 user nova-compute[74075]:       <mac address="fa:16:3e:b5:b5:5b"/>
Oct 26 09:32:47 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:47 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:32:47 user nova-compute[74075]:       <target dev="tapbbf845ec-94"/>
Oct 26 09:32:47 user nova-compute[74075]:     </interface>
Oct 26 09:32:47 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:32:47 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/console.log" append="off"/>
Oct 26 09:32:47 user nova-compute[74075]:     </serial>
Oct 26 09:32:47 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:32:47 user nova-compute[74075]:     <video>
Oct 26 09:32:47 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:47 user nova-compute[74075]:     </video>
Oct 26 09:32:47 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:32:47 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:32:47 user nova-compute[74075]:     </rng>
Oct 26 09:32:47 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:32:47 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:32:47 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:32:47 user nova-compute[74075]:     </memballoon>
Oct 26 09:32:47 user nova-compute[74075]:   </devices>
Oct 26 09:32:47 user nova-compute[74075]: </domain>
Oct 26 09:32:47 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Cannot resize image /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.objects.instance [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'migration_context' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.objects.base [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Object Instance<e4baa273-79c9-408c-9c41-17e202582246> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG os_vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '612fcdba-9c77-5adb-839c-f977216dfdee', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbf845ec-94, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbf845ec-94, col_values=(('qos', UUID('67d527d4-cd0e-46b1-b400-f63934118224')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbf845ec-94, col_values=(('external_ids', {'iface-id': 'bbf845ec-94f6-4489-a12d-2bc5cca19e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b5:5b', 'vm-uuid': 'e4baa273-79c9-408c-9c41-17e202582246'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:48 user nova-compute[74075]: INFO os_vif [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94')
Oct 26 09:32:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:32:50 user nova-compute[74075]: INFO nova.compute.claims [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Claim successful on node user
Oct 26 09:32:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:32:50 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.policy [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7604ae732734f05aaa7aeebf8ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07b30415774466817048f8090437ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:32:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Creating image(s)
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "/opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk 1073741824" returned: 0 in 0.064s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:32:52 user nova-compute[74075]: INFO nova.compute.claims [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Claim successful on node user
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.230s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Successfully created port: 679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Cannot resize image /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Ensure instance console log exists: /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-0c010a10-7254-462d-9a83-cf8664d944fc req-0df32fcc-412a-43d3-89f7-5fc6eb6364b1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0c010a10-7254-462d-9a83-cf8664d944fc req-0df32fcc-412a-43d3-89f7-5fc6eb6364b1 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0c010a10-7254-462d-9a83-cf8664d944fc req-0df32fcc-412a-43d3-89f7-5fc6eb6364b1 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0c010a10-7254-462d-9a83-cf8664d944fc req-0df32fcc-412a-43d3-89f7-5fc6eb6364b1 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-0c010a10-7254-462d-9a83-cf8664d944fc req-0df32fcc-412a-43d3-89f7-5fc6eb6364b1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:52 user nova-compute[74075]: WARNING nova.compute.manager [req-0c010a10-7254-462d-9a83-cf8664d944fc req-0df32fcc-412a-43d3-89f7-5fc6eb6364b1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state stopped and task_state powering-on.
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.network.neutron [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:32:52 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.policy [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d86b9184a1410db33192820885da0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453d88800e642b98d9b66dde5fe2e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:32:52 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance rebooted successfully.
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-671e4619-0e92-47f9-9c6a-e425bc91d202 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:32:52 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Creating image(s)
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Successfully updated port: 679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquired lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-changed-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Refreshing instance network info cache due to event network-changed-679c010d-71ce-4729-89bf-c3e242b330a6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] Acquiring lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: e4baa273-79c9-408c-9c41-17e202582246] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.219s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk 1073741824" returned: 0 in 0.063s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updating instance_info_cache with network_info: [{"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Releasing lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Instance network_info: |[{"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] Acquired lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.neutron [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Refreshing network info cache for port 679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Start _get_guest_xml network_info=[{"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:32:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1750273276',display_name='tempest-AttachVolumeNegativeTest-server-1750273276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1750273276',id=18,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjJHWn+iHEqM+8pI6FdijZwEAGjl+E2GLMRYQSy6dMB0121ayiJWj7UbKmHTB8jAi5jLwGaMtg2wJWrEE973JAjtsCYzQ0q6b9rwCVkx8+WNmEbm7Chwo8JytTdxErfWw==',key_name='tempest-keypair-1709392585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-busfm2o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=fccf2eec-a34b-47bc-bbc4-0369faf87a9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'pci_devices' on Instance uuid fccf2eec-a34b-47bc-bbc4-0369faf87a9c {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:32:53 user nova-compute[74075]:   <uuid>fccf2eec-a34b-47bc-bbc4-0369faf87a9c</uuid>
Oct 26 09:32:53 user nova-compute[74075]:   <name>instance-00000012</name>
Oct 26 09:32:53 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:32:53 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:32:53 user nova-compute[74075]:   <metadata>
Oct 26 09:32:53 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:32:53 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:32:53 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1750273276</nova:name>
Oct 26 09:32:53 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:32:53</nova:creationTime>
Oct 26 09:32:53 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:32:53 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:32:53 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:32:53 user nova-compute[74075]:       <nova:owner>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:user uuid="c7604ae732734f05aaa7aeebf8ef5e1a">tempest-AttachVolumeNegativeTest-294403091-project-member</nova:user>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:project uuid="2e07b30415774466817048f8090437ee">tempest-AttachVolumeNegativeTest-294403091</nova:project>
Oct 26 09:32:53 user nova-compute[74075]:       </nova:owner>
Oct 26 09:32:53 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:32:53 user nova-compute[74075]:       <nova:ports>
Oct 26 09:32:53 user nova-compute[74075]:         <nova:port uuid="679c010d-71ce-4729-89bf-c3e242b330a6">
Oct 26 09:32:53 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 09:32:53 user nova-compute[74075]:         </nova:port>
Oct 26 09:32:53 user nova-compute[74075]:       </nova:ports>
Oct 26 09:32:53 user nova-compute[74075]:     </nova:instance>
Oct 26 09:32:53 user nova-compute[74075]:   </metadata>
Oct 26 09:32:53 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:32:53 user nova-compute[74075]:     <system>
Oct 26 09:32:53 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:32:53 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:32:53 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:32:53 user nova-compute[74075]:       <entry name="serial">fccf2eec-a34b-47bc-bbc4-0369faf87a9c</entry>
Oct 26 09:32:53 user nova-compute[74075]:       <entry name="uuid">fccf2eec-a34b-47bc-bbc4-0369faf87a9c</entry>
Oct 26 09:32:53 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:32:53 user nova-compute[74075]:     </system>
Oct 26 09:32:53 user nova-compute[74075]:   </sysinfo>
Oct 26 09:32:53 user nova-compute[74075]:   <os>
Oct 26 09:32:53 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:32:53 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:32:53 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:32:53 user nova-compute[74075]:   </os>
Oct 26 09:32:53 user nova-compute[74075]:   <features>
Oct 26 09:32:53 user nova-compute[74075]:     <acpi/>
Oct 26 09:32:53 user nova-compute[74075]:     <apic/>
Oct 26 09:32:53 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:32:53 user nova-compute[74075]:   </features>
Oct 26 09:32:53 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:32:53 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:32:53 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:32:53 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:32:53 user nova-compute[74075]:   </clock>
Oct 26 09:32:53 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:32:53 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:32:53 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:32:53 user nova-compute[74075]:   </cpu>
Oct 26 09:32:53 user nova-compute[74075]:   <devices>
Oct 26 09:32:53 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:32:53 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:32:53 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk"/>
Oct 26 09:32:53 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:32:53 user nova-compute[74075]:     </disk>
Oct 26 09:32:53 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:32:53 user nova-compute[74075]:       <mac address="fa:16:3e:a8:65:9c"/>
Oct 26 09:32:53 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:53 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:32:53 user nova-compute[74075]:       <target dev="tap679c010d-71"/>
Oct 26 09:32:53 user nova-compute[74075]:     </interface>
Oct 26 09:32:53 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:32:53 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/console.log" append="off"/>
Oct 26 09:32:53 user nova-compute[74075]:     </serial>
Oct 26 09:32:53 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:32:53 user nova-compute[74075]:     <video>
Oct 26 09:32:53 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:53 user nova-compute[74075]:     </video>
Oct 26 09:32:53 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:32:53 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:32:53 user nova-compute[74075]:     </rng>
Oct 26 09:32:53 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:32:53 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:32:53 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:32:53 user nova-compute[74075]:     </memballoon>
Oct 26 09:32:53 user nova-compute[74075]:   </devices>
Oct 26 09:32:53 user nova-compute[74075]: </domain>
Oct 26 09:32:53 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1750273276',display_name='tempest-AttachVolumeNegativeTest-server-1750273276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1750273276',id=18,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjJHWn+iHEqM+8pI6FdijZwEAGjl+E2GLMRYQSy6dMB0121ayiJWj7UbKmHTB8jAi5jLwGaMtg2wJWrEE973JAjtsCYzQ0q6b9rwCVkx8+WNmEbm7Chwo8JytTdxErfWw==',key_name='tempest-keypair-1709392585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-busfm2o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=fccf2eec-a34b-47bc-bbc4-0369faf87a9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG os_vif [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad80479f-a2dd-54e7-b358-e6a6c3c79442', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap679c010d-71, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap679c010d-71, col_values=(('qos', UUID('94d8083d-6a51-4c55-bb76-d3834b0ef4b4')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap679c010d-71, col_values=(('external_ids', {'iface-id': '679c010d-71ce-4729-89bf-c3e242b330a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:65:9c', 'vm-uuid': 'fccf2eec-a34b-47bc-bbc4-0369faf87a9c'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:53 user nova-compute[74075]: INFO os_vif [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71')
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.258s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:a8:65:9c, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [{"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-e4baa273-79c9-408c-9c41-17e202582246" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.network.neutron [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Successfully created port: f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updated VIF entry in instance network info cache for port 679c010d-71ce-4729-89bf-c3e242b330a6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updating instance_info_cache with network_info: [{"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b6eaeae7-e93b-4e79-aed6-45c267600881 req-82f176d6-94ff-42ae-b783-cc32eb9d0c5c service nova] Releasing lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e34d4fc-8c55-4c17-a0b7-2df888a68b1d req-c952a3bb-c4fe-48b6-97ed-790bca0c23b1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e34d4fc-8c55-4c17-a0b7-2df888a68b1d req-c952a3bb-c4fe-48b6-97ed-790bca0c23b1 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e34d4fc-8c55-4c17-a0b7-2df888a68b1d req-c952a3bb-c4fe-48b6-97ed-790bca0c23b1 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e34d4fc-8c55-4c17-a0b7-2df888a68b1d req-c952a3bb-c4fe-48b6-97ed-790bca0c23b1 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e34d4fc-8c55-4c17-a0b7-2df888a68b1d req-c952a3bb-c4fe-48b6-97ed-790bca0c23b1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:54 user nova-compute[74075]: WARNING nova.compute.manager [req-1e34d4fc-8c55-4c17-a0b7-2df888a68b1d req-c952a3bb-c4fe-48b6-97ed-790bca0c23b1 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state active and task_state None.
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Successfully updated port: f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing instance network info cache due to event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance network_info: |[{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Start _get_guest_xml network_info=[{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:32:55 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:55 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494371913',display_name='tempest-ServerRescueNegativeTestJSON-server-494371913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494371913',id=19,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx/2xyx2khvJf9M6jt2G8MvWCuIOewmaKhtW8HAYNr666l+pDtMz3sB09XwYzZiqd0p+4Axm5iL+qYQE1Uc0D1F9F7LDpKJqX9Q3xKXA/rYBzjnu9kIwZWHmgPAMkUxKA==',key_name='tempest-keypair-2032257308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-6p8lgs3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d86b9184a1410db33192820885da0f',uuid=0ed7d017-b761-4efe-9cc6-995fac04dd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:32:55 user nova-compute[74075]:   <uuid>0ed7d017-b761-4efe-9cc6-995fac04dd58</uuid>
Oct 26 09:32:55 user nova-compute[74075]:   <name>instance-00000013</name>
Oct 26 09:32:55 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:32:55 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:32:55 user nova-compute[74075]:   <metadata>
Oct 26 09:32:55 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:32:55 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:32:55 user nova-compute[74075]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-494371913</nova:name>
Oct 26 09:32:55 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:32:55</nova:creationTime>
Oct 26 09:32:55 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:32:55 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:32:55 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:32:55 user nova-compute[74075]:       <nova:owner>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:user uuid="82d86b9184a1410db33192820885da0f">tempest-ServerRescueNegativeTestJSON-336149992-project-member</nova:user>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:project uuid="e453d88800e642b98d9b66dde5fe2e73">tempest-ServerRescueNegativeTestJSON-336149992</nova:project>
Oct 26 09:32:55 user nova-compute[74075]:       </nova:owner>
Oct 26 09:32:55 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:32:55 user nova-compute[74075]:       <nova:ports>
Oct 26 09:32:55 user nova-compute[74075]:         <nova:port uuid="f1bec6c3-c88d-4e3e-bcea-b3f7eb728867">
Oct 26 09:32:55 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 09:32:55 user nova-compute[74075]:         </nova:port>
Oct 26 09:32:55 user nova-compute[74075]:       </nova:ports>
Oct 26 09:32:55 user nova-compute[74075]:     </nova:instance>
Oct 26 09:32:55 user nova-compute[74075]:   </metadata>
Oct 26 09:32:55 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:32:55 user nova-compute[74075]:     <system>
Oct 26 09:32:55 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:32:55 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:32:55 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:32:55 user nova-compute[74075]:       <entry name="serial">0ed7d017-b761-4efe-9cc6-995fac04dd58</entry>
Oct 26 09:32:55 user nova-compute[74075]:       <entry name="uuid">0ed7d017-b761-4efe-9cc6-995fac04dd58</entry>
Oct 26 09:32:55 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:32:55 user nova-compute[74075]:     </system>
Oct 26 09:32:55 user nova-compute[74075]:   </sysinfo>
Oct 26 09:32:55 user nova-compute[74075]:   <os>
Oct 26 09:32:55 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:32:55 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:32:55 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:32:55 user nova-compute[74075]:   </os>
Oct 26 09:32:55 user nova-compute[74075]:   <features>
Oct 26 09:32:55 user nova-compute[74075]:     <acpi/>
Oct 26 09:32:55 user nova-compute[74075]:     <apic/>
Oct 26 09:32:55 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:32:55 user nova-compute[74075]:   </features>
Oct 26 09:32:55 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:32:55 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:32:55 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:32:55 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:32:55 user nova-compute[74075]:   </clock>
Oct 26 09:32:55 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:32:55 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:32:55 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:32:55 user nova-compute[74075]:   </cpu>
Oct 26 09:32:55 user nova-compute[74075]:   <devices>
Oct 26 09:32:55 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:32:55 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:32:55 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk"/>
Oct 26 09:32:55 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:32:55 user nova-compute[74075]:     </disk>
Oct 26 09:32:55 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:32:55 user nova-compute[74075]:       <mac address="fa:16:3e:a2:8a:17"/>
Oct 26 09:32:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:55 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:32:55 user nova-compute[74075]:       <target dev="tapf1bec6c3-c8"/>
Oct 26 09:32:55 user nova-compute[74075]:     </interface>
Oct 26 09:32:55 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:32:55 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/console.log" append="off"/>
Oct 26 09:32:55 user nova-compute[74075]:     </serial>
Oct 26 09:32:55 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:32:55 user nova-compute[74075]:     <video>
Oct 26 09:32:55 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:32:55 user nova-compute[74075]:     </video>
Oct 26 09:32:55 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:32:55 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:32:55 user nova-compute[74075]:     </rng>
Oct 26 09:32:55 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:32:55 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:32:55 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:32:55 user nova-compute[74075]:     </memballoon>
Oct 26 09:32:55 user nova-compute[74075]:   </devices>
Oct 26 09:32:55 user nova-compute[74075]: </domain>
Oct 26 09:32:55 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494371913',display_name='tempest-ServerRescueNegativeTestJSON-server-494371913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494371913',id=19,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx/2xyx2khvJf9M6jt2G8MvWCuIOewmaKhtW8HAYNr666l+pDtMz3sB09XwYzZiqd0p+4Axm5iL+qYQE1Uc0D1F9F7LDpKJqX9Q3xKXA/rYBzjnu9kIwZWHmgPAMkUxKA==',key_name='tempest-keypair-2032257308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-6p8lgs3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d86b9184a1410db33192820885da0f',uuid=0ed7d017-b761-4efe-9cc6-995fac04dd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG os_vif [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f74f127-2fdc-5715-a4c0-89991cd26c0e', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1bec6c3-c8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1bec6c3-c8, col_values=(('qos', UUID('c09a0efb-a837-4e10-87b9-910461df43d6')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1bec6c3-c8, col_values=(('external_ids', {'iface-id': 'f1bec6c3-c88d-4e3e-bcea-b3f7eb728867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:8a:17', 'vm-uuid': '0ed7d017-b761-4efe-9cc6-995fac04dd58'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:55 user nova-compute[74075]: INFO os_vif [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8')
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:a2:8a:17, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-a6b68d8b-8daf-44cf-a415-16179f01cbb6 req-b2a3f03b-ef14-42be-99a7-17590f53a8e1 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a6b68d8b-8daf-44cf-a415-16179f01cbb6 req-b2a3f03b-ef14-42be-99a7-17590f53a8e1 service nova] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a6b68d8b-8daf-44cf-a415-16179f01cbb6 req-b2a3f03b-ef14-42be-99a7-17590f53a8e1 service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a6b68d8b-8daf-44cf-a415-16179f01cbb6 req-b2a3f03b-ef14-42be-99a7-17590f53a8e1 service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-a6b68d8b-8daf-44cf-a415-16179f01cbb6 req-b2a3f03b-ef14-42be-99a7-17590f53a8e1 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] No waiting events found dispatching network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:55 user nova-compute[74075]: WARNING nova.compute.manager [req-a6b68d8b-8daf-44cf-a415-16179f01cbb6 req-b2a3f03b-ef14-42be-99a7-17590f53a8e1 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received unexpected event network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 for instance with vm_state building and task_state spawning.
Oct 26 09:32:56 user nova-compute[74075]: DEBUG nova.network.neutron [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updated VIF entry in instance network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG nova.network.neutron [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b4dbc1cf-043a-4a95-b2b3-d988ceecd992 req-6b0176a5-c563-41b9-9bc8-89ae22cc0769 service nova] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-7eba3c58-3d61-4ac6-849c-bcb8ef752a76 req-d51985df-4c3a-4d9b-b929-3ab8d5bd8dd4 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7eba3c58-3d61-4ac6-849c-bcb8ef752a76 req-d51985df-4c3a-4d9b-b929-3ab8d5bd8dd4 service nova] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7eba3c58-3d61-4ac6-849c-bcb8ef752a76 req-d51985df-4c3a-4d9b-b929-3ab8d5bd8dd4 service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7eba3c58-3d61-4ac6-849c-bcb8ef752a76 req-d51985df-4c3a-4d9b-b929-3ab8d5bd8dd4 service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-7eba3c58-3d61-4ac6-849c-bcb8ef752a76 req-d51985df-4c3a-4d9b-b929-3ab8d5bd8dd4 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] No waiting events found dispatching network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:57 user nova-compute[74075]: WARNING nova.compute.manager [req-7eba3c58-3d61-4ac6-849c-bcb8ef752a76 req-d51985df-4c3a-4d9b-b929-3ab8d5bd8dd4 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received unexpected event network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 for instance with vm_state building and task_state spawning.
Oct 26 09:32:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-99c37315-06f6-4037-b4df-ec86baf124da req-a3532d3c-72fa-40a4-adf3-96301f415ff8 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-99c37315-06f6-4037-b4df-ec86baf124da req-a3532d3c-72fa-40a4-adf3-96301f415ff8 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-99c37315-06f6-4037-b4df-ec86baf124da req-a3532d3c-72fa-40a4-adf3-96301f415ff8 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-99c37315-06f6-4037-b4df-ec86baf124da req-a3532d3c-72fa-40a4-adf3-96301f415ff8 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:32:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-99c37315-06f6-4037-b4df-ec86baf124da req-a3532d3c-72fa-40a4-adf3-96301f415ff8 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:32:58 user nova-compute[74075]: WARNING nova.compute.manager [req-99c37315-06f6-4037-b4df-ec86baf124da req-a3532d3c-72fa-40a4-adf3-96301f415ff8 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state building and task_state spawning.
Oct 26 09:32:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:32:59 user nova-compute[74075]: INFO nova.compute.claims [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Claim successful on node user
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:32:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:32:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Instance spawned successfully.
Oct 26 09:32:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:33:00 user nova-compute[74075]: INFO nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Took 8.85 seconds to spawn the instance on the hypervisor.
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:33:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:33:00 user nova-compute[74075]: INFO nova.compute.manager [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Took 10.12 seconds to build instance.
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-980409ad-57c8-46c7-b426-ff86ce3bf383 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.276s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.policy [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05e6ea9a6e248e892fb237a31d4b1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf8f091fdd04a9c8e5b14632402efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:33:00 user nova-compute[74075]: INFO nova.virt.block_device [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Booting with blank volume at /dev/vda
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:33:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance spawned successfully.
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:33:00 user nova-compute[74075]: INFO nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Took 7.81 seconds to spawn the instance on the hypervisor.
Oct 26 09:33:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-8171305e-b974-454f-8f12-2d2945269f36 req-db402f9a-c42a-4827-a53d-0854de278f3b service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8171305e-b974-454f-8f12-2d2945269f36 req-db402f9a-c42a-4827-a53d-0854de278f3b service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8171305e-b974-454f-8f12-2d2945269f36 req-db402f9a-c42a-4827-a53d-0854de278f3b service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8171305e-b974-454f-8f12-2d2945269f36 req-db402f9a-c42a-4827-a53d-0854de278f3b service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-8171305e-b974-454f-8f12-2d2945269f36 req-db402f9a-c42a-4827-a53d-0854de278f3b service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:33:01 user nova-compute[74075]: WARNING nova.compute.manager [req-8171305e-b974-454f-8f12-2d2945269f36 req-db402f9a-c42a-4827-a53d-0854de278f3b service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state active and task_state None.
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.588s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Successfully created port: 06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:33:01 user nova-compute[74075]: INFO nova.compute.manager [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Took 9.40 seconds to build instance.
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:33:01 user nova-compute[74075]: INFO nova.compute.claims [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Claim successful on node user
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-30aed0c9-b3ce-41fd-aa8a-b3199260d669 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.568s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.750s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Successfully updated port: 06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-changed-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Refreshing instance network info cache due to event network-changed-06454434-823c-4a71-a950-ff140c5e2003. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] Acquiring lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:33:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.policy [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb1c1ea1d50b40cfb52679eeea0133dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be82ea29d3e4ac391dcc1c46821188b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:33:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Creating image(s)
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "/opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "/opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "/opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.289s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk 1073741824" returned: 0 in 0.093s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance network_info: |[{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] Acquired lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Refreshing network info cache for port 06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.259s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Cannot resize image /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Ensure instance console log exists: /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Successfully created port: 57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.compute.manager [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-changed-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.compute.manager [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Refreshing instance network info cache due to event network-changed-0f2ea36f-be05-482a-bd66-736c4d8b36f0. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Refreshing network info cache for port 0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updated VIF entry in instance network info cache for port 06454434-823c-4a71-a950-ff140c5e2003. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-58b0d3e1-fa93-4ae1-aba5-191178b78f97 req-38db8d24-4132-4033-b5dd-6e8aa350a724 service nova] Releasing lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.50274658203125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dc06e7b9-860e-4ba3-8918-9b2f9dc21856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b51b900c-8776-4654-8acd-4d406a5ed7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Successfully updated port: 57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "refresh_cache-b51b900c-8776-4654-8acd-4d406a5ed7b9" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquired lock "refresh_cache-b51b900c-8776-4654-8acd-4d406a5ed7b9" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-changed-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Refreshing instance network info cache due to event network-changed-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] Acquiring lock "refresh_cache-b51b900c-8776-4654-8acd-4d406a5ed7b9" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updated VIF entry in instance network info cache for port 0f2ea36f-be05-482a-bd66-736c4d8b36f0. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12a3143a-00be-44a4-8c5b-e701405e5743 req-47ae8e15-24e9-4474-90b3-2be2aa50f66a service nova] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.878s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Updating instance_info_cache with network_info: [{"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Releasing lock "refresh_cache-b51b900c-8776-4654-8acd-4d406a5ed7b9" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Instance network_info: |[{"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] Acquired lock "refresh_cache-b51b900c-8776-4654-8acd-4d406a5ed7b9" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Refreshing network info cache for port 57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Start _get_guest_xml network_info=[{"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:33:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-364408767',display_name='tempest-DeleteServersTestJSON-server-364408767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-364408767',id=21,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be82ea29d3e4ac391dcc1c46821188b',ramdisk_id='',reservation_id='r-st20xg43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-159528353',owner_user_name='tempest-DeleteServersTestJSON-159528353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:33:02Z,user_data=None,user_id='cb1c1ea1d50b40cfb52679eeea0133dd',uuid=b51b900c-8776-4654-8acd-4d406a5ed7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Converting VIF {"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lazy-loading 'pci_devices' on Instance uuid b51b900c-8776-4654-8acd-4d406a5ed7b9 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:33:05 user nova-compute[74075]:   <uuid>b51b900c-8776-4654-8acd-4d406a5ed7b9</uuid>
Oct 26 09:33:05 user nova-compute[74075]:   <name>instance-00000015</name>
Oct 26 09:33:05 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:33:05 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:33:05 user nova-compute[74075]:   <metadata>
Oct 26 09:33:05 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:33:05 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:33:05 user nova-compute[74075]:       <nova:name>tempest-DeleteServersTestJSON-server-364408767</nova:name>
Oct 26 09:33:05 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:33:05</nova:creationTime>
Oct 26 09:33:05 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:33:05 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:33:05 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:33:05 user nova-compute[74075]:       <nova:owner>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:user uuid="cb1c1ea1d50b40cfb52679eeea0133dd">tempest-DeleteServersTestJSON-159528353-project-member</nova:user>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:project uuid="3be82ea29d3e4ac391dcc1c46821188b">tempest-DeleteServersTestJSON-159528353</nova:project>
Oct 26 09:33:05 user nova-compute[74075]:       </nova:owner>
Oct 26 09:33:05 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:33:05 user nova-compute[74075]:       <nova:ports>
Oct 26 09:33:05 user nova-compute[74075]:         <nova:port uuid="57185cbe-feb3-499e-9c6d-ddfa9e7f7d02">
Oct 26 09:33:05 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 09:33:05 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:05 user nova-compute[74075]:       </nova:ports>
Oct 26 09:33:05 user nova-compute[74075]:     </nova:instance>
Oct 26 09:33:05 user nova-compute[74075]:   </metadata>
Oct 26 09:33:05 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:33:05 user nova-compute[74075]:     <system>
Oct 26 09:33:05 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:33:05 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:33:05 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:33:05 user nova-compute[74075]:       <entry name="serial">b51b900c-8776-4654-8acd-4d406a5ed7b9</entry>
Oct 26 09:33:05 user nova-compute[74075]:       <entry name="uuid">b51b900c-8776-4654-8acd-4d406a5ed7b9</entry>
Oct 26 09:33:05 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:33:05 user nova-compute[74075]:     </system>
Oct 26 09:33:05 user nova-compute[74075]:   </sysinfo>
Oct 26 09:33:05 user nova-compute[74075]:   <os>
Oct 26 09:33:05 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:33:05 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:33:05 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:33:05 user nova-compute[74075]:   </os>
Oct 26 09:33:05 user nova-compute[74075]:   <features>
Oct 26 09:33:05 user nova-compute[74075]:     <acpi/>
Oct 26 09:33:05 user nova-compute[74075]:     <apic/>
Oct 26 09:33:05 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:33:05 user nova-compute[74075]:   </features>
Oct 26 09:33:05 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:33:05 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:33:05 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:33:05 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:33:05 user nova-compute[74075]:   </clock>
Oct 26 09:33:05 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:33:05 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:33:05 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:33:05 user nova-compute[74075]:   </cpu>
Oct 26 09:33:05 user nova-compute[74075]:   <devices>
Oct 26 09:33:05 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:33:05 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:33:05 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk"/>
Oct 26 09:33:05 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:33:05 user nova-compute[74075]:     </disk>
Oct 26 09:33:05 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:05 user nova-compute[74075]:       <mac address="fa:16:3e:35:6c:6b"/>
Oct 26 09:33:05 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:05 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:05 user nova-compute[74075]:       <target dev="tap57185cbe-fe"/>
Oct 26 09:33:05 user nova-compute[74075]:     </interface>
Oct 26 09:33:05 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:33:05 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/console.log" append="off"/>
Oct 26 09:33:05 user nova-compute[74075]:     </serial>
Oct 26 09:33:05 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:33:05 user nova-compute[74075]:     <video>
Oct 26 09:33:05 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:05 user nova-compute[74075]:     </video>
Oct 26 09:33:05 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:33:05 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:33:05 user nova-compute[74075]:     </rng>
Oct 26 09:33:05 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:33:05 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:33:05 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:33:05 user nova-compute[74075]:     </memballoon>
Oct 26 09:33:05 user nova-compute[74075]:   </devices>
Oct 26 09:33:05 user nova-compute[74075]: </domain>
Oct 26 09:33:05 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-364408767',display_name='tempest-DeleteServersTestJSON-server-364408767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-364408767',id=21,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be82ea29d3e4ac391dcc1c46821188b',ramdisk_id='',reservation_id='r-st20xg43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-159528353',owner_user_name='tempest-DeleteServersTestJSON-159528353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:33:02Z,user_data=None,user_id='cb1c1ea1d50b40cfb52679eeea0133dd',uuid=b51b900c-8776-4654-8acd-4d406a5ed7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Converting VIF {"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG os_vif [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7dd7ad5-325c-5dca-9097-914029077cfe', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57185cbe-fe, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57185cbe-fe, col_values=(('qos', UUID('e9d5bf11-bdaa-4e3b-9759-99084b8f2244')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57185cbe-fe, col_values=(('external_ids', {'iface-id': '57185cbe-feb3-499e-9c6d-ddfa9e7f7d02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:6c:6b', 'vm-uuid': 'b51b900c-8776-4654-8acd-4d406a5ed7b9'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:05 user nova-compute[74075]: INFO os_vif [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe')
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] No VIF found with MAC fa:16:3e:35:6c:6b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Updated VIF entry in instance network info cache for port 57185cbe-feb3-499e-9c6d-ddfa9e7f7d02. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Updating instance_info_cache with network_info: [{"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a8d611a-ea98-49d3-84e7-d9eb26906cf0 req-a9e51886-7f28-4392-b860-5f3975aed8d0 service nova] Releasing lock "refresh_cache-b51b900c-8776-4654-8acd-4d406a5ed7b9" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-changed-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Refreshing instance network info cache due to event network-changed-98e149e6-16b9-4b73-b3cb-8db9085814c6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.network.neutron [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Refreshing network info cache for port 98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG nova.network.neutron [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updated VIF entry in instance network info cache for port 98e149e6-16b9-4b73-b3cb-8db9085814c6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG nova.network.neutron [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2dee6e5-5029-4665-8e71-a10362321d37 req-de1342a3-a0d9-4f4d-8634-eb783194c76a service nova] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-b5a7b385-e5aa-4939-a940-4fbf3406bc6f req-bb440dee-cf30-402c-b1ae-040b89a1cb49 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b5a7b385-e5aa-4939-a940-4fbf3406bc6f req-bb440dee-cf30-402c-b1ae-040b89a1cb49 service nova] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b5a7b385-e5aa-4939-a940-4fbf3406bc6f req-bb440dee-cf30-402c-b1ae-040b89a1cb49 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b5a7b385-e5aa-4939-a940-4fbf3406bc6f req-bb440dee-cf30-402c-b1ae-040b89a1cb49 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-b5a7b385-e5aa-4939-a940-4fbf3406bc6f req-bb440dee-cf30-402c-b1ae-040b89a1cb49 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] No waiting events found dispatching network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:33:07 user nova-compute[74075]: WARNING nova.compute.manager [req-b5a7b385-e5aa-4939-a940-4fbf3406bc6f req-bb440dee-cf30-402c-b1ae-040b89a1cb49 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received unexpected event network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 for instance with vm_state building and task_state spawning.
Oct 26 09:33:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:09 user nova-compute[74075]: INFO nova.virt.block_device [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Booting with volume bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 at /dev/vdc
Oct 26 09:33:09 user nova-compute[74075]: DEBUG os_brick.utils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2e4e28-b141-4791-a785-1141851fd52c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aea4806-6cd8-409d-8aa4-4afb7c086702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30a98f-6931-41f4-ba2c-6f19073b7011]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bd6d7-de3b-4b7e-a7bc-ef934180f835]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:33:09 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:33:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9844b-0178-448e-89d2-1acad38682b4]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG os_brick.utils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:33:09 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating existing volume attachment record: a6fcaf17-0292-47c9-a425-ed0afdf08511 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc302901-6f37-4545-bee5-26026e8b7e66 req-1e4e3d86-9b7c-4a4b-bb13-654eb62ebf73 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc302901-6f37-4545-bee5-26026e8b7e66 req-1e4e3d86-9b7c-4a4b-bb13-654eb62ebf73 service nova] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc302901-6f37-4545-bee5-26026e8b7e66 req-1e4e3d86-9b7c-4a4b-bb13-654eb62ebf73 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc302901-6f37-4545-bee5-26026e8b7e66 req-1e4e3d86-9b7c-4a4b-bb13-654eb62ebf73 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc302901-6f37-4545-bee5-26026e8b7e66 req-1e4e3d86-9b7c-4a4b-bb13-654eb62ebf73 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] No waiting events found dispatching network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:33:10 user nova-compute[74075]: WARNING nova.compute.manager [req-cc302901-6f37-4545-bee5-26026e8b7e66 req-1e4e3d86-9b7c-4a4b-bb13-654eb62ebf73 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received unexpected event network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 for instance with vm_state building and task_state spawning.
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:33:10 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Instance spawned successfully.
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:10 user nova-compute[74075]: INFO nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Took 7.78 seconds to spawn the instance on the hypervisor.
Oct 26 09:33:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:33:10 user nova-compute[74075]: INFO nova.compute.manager [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Took 9.19 seconds to build instance.
Oct 26 09:33:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5ec7605d-6774-45ac-89f8-0d005e80afe2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.785s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG os_brick.utils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a8b50-654a-454c-90c9-5f6bcfd17b75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d36738-deba-4864-a2f7-a9e4e807aaa2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128b5de-23c1-4c9f-a34f-85b77d2770b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde4ff0-f8dd-4e9c-b191-7ba8abded887]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:33:16 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:33:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[978d318b-ba24-471e-b988-34ac0d0f7f9c]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG os_brick.utils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:33:16 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating existing volume attachment record: 2f917335-e2c9-443b-bbcb-70c34a091be8 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:33:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:33:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Creating image(s)
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Ensure instance console log exists: /opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Start _get_guest_xml network_info=[{"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '48265b54-2238-40f3-909e-e67940c8f178', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYNiOJUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764', 'attached_at': '', 'detached_at': '', 'volume_id': '6922b977-39aa-40c8-96e3-f722ccf6f275', 'serial': '6922b977-39aa-40c8-96e3-f722ccf6f275'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': '85c866c0-cd42-46a8-9fb9-b93228ba8998', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdfZUKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9d429dd-394a-43d1-94ad-48a5feff4663', 'serial': 'b9d429dd-394a-43d1-94ad-48a5feff4663'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': 'a6fcaf17-0292-47c9-a425-ed0afdf08511', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnITpuAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31', 'serial': 'bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:33:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Creating image(s)
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Ensure instance console log exists: /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Start _get_guest_xml network_info=[{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '2f917335-e2c9-443b-bbcb-70c34a091be8', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b522482-66ab-4ae4-b851-9e4b74433fe6', 'attached_at': '', 'detached_at': '', 'volume_id': '4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'serial': '4a945ccc-dbb8-4338-84ee-d7d247be53f2'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:33:51 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:51 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:51 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:51 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYNiOJUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:33:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:51 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:33:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8de6dc-5c45-4090-bdee-b655a66188c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:33:51 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7050b3-afa2-4914-a7a6-22b41cc91248]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275] added
Oct 26 09:33:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696e2b2-aa71-4ead-b593-825bd185dde6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea24275-ae3f-45d4-bc87-662861d8fddc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYNiOJUt {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYNiOJUt" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce0f8ef-3990-4e2e-854a-9c852c58c35a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYNiOJUt'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef2953f-7efc-4c93-89d6-d064686750c6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7845a8-9d45-41b7-b787-1d1c1aab4e9d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:33:51 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:33:51 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 09:33:51 user nova-compute[74075]: 
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[669cf253-2e8a-4f49-9143-f21d226d26b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260]
Oct 26 09:33:51 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260] successful.
Oct 26 09:33:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff2aed9-18ad-4461-9971-763456cadbfa]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[97908bc3-23cd-4b9a-b7d6-bb4c3a80236d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a920bcaa-0260-47aa-bc40-d6eae1b36909]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYNiOJUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26661653764666439', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661653764666439', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.264s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:52 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:52 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57285d7-2495-45df-ac79-a69849a82013]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:33:52 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdfZUKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:33:52 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aebc9ce-fa0c-4e29-9c46-b3781c013c85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2] added
Oct 26 09:33:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea15a0-c1df-4871-8b57-109cade7c197]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22a310f-bc11-4a87-93c1-8f3d9177531d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cALwitfb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cALwitfb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07be5bc-78f2-4a51-a574-4b75b52dd535]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cALwitfb'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7987f09-74b5-45fd-b0fa-58e5efe94b12]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bbe072-725f-47f6-90ae-aeb5af8146eb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c4fbf-fd10-4286-8b4b-2771ee2553f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260]
Oct 26 09:33:53 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260] successful.
Oct 26 09:33:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[325df0f5-0b85-42c0-9ab8-d9fc5ec65289]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a74619-d9eb-4b56-a1c9-09385006b4c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:53 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:53 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4fd95f-c0bd-47ed-89e8-001002c55a5e]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:33:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== connect_volume: return (2572ms) {'type': 'block', 'scsi_wwn': '26637633765303730', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633765303730', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.280s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:54 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:54 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72286ed-a18d-49a4-b396-e2f22206498c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:33:54 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e22fc2-c5f9-4426-b6ec-4536160566b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663] added
Oct 26 09:33:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-192025782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-192025782',id=20,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-lxucicnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:33:00Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=8b522482-66ab-4ae4-b851-9e4b74433fe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:33:54 user nova-compute[74075]:   <uuid>8b522482-66ab-4ae4-b851-9e4b74433fe6</uuid>
Oct 26 09:33:54 user nova-compute[74075]:   <name>instance-00000014</name>
Oct 26 09:33:54 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:33:54 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:33:54 user nova-compute[74075]:   <metadata>
Oct 26 09:33:54 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:33:54 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:33:54 user nova-compute[74075]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-192025782</nova:name>
Oct 26 09:33:54 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:33:51</nova:creationTime>
Oct 26 09:33:54 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:33:54 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:33:54 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:33:54 user nova-compute[74075]:       <nova:owner>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:user uuid="f05e6ea9a6e248e892fb237a31d4b1a1">tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member</nova:user>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:project uuid="abf8f091fdd04a9c8e5b14632402efae">tempest-ServerBootFromVolumeStableRescueTest-1733320520</nova:project>
Oct 26 09:33:54 user nova-compute[74075]:       </nova:owner>
Oct 26 09:33:54 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:33:54 user nova-compute[74075]:       <nova:ports>
Oct 26 09:33:54 user nova-compute[74075]:         <nova:port uuid="06454434-823c-4a71-a950-ff140c5e2003">
Oct 26 09:33:54 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:33:54 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:54 user nova-compute[74075]:       </nova:ports>
Oct 26 09:33:54 user nova-compute[74075]:     </nova:instance>
Oct 26 09:33:54 user nova-compute[74075]:   </metadata>
Oct 26 09:33:54 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:33:54 user nova-compute[74075]:     <system>
Oct 26 09:33:54 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:33:54 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:33:54 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:33:54 user nova-compute[74075]:       <entry name="serial">8b522482-66ab-4ae4-b851-9e4b74433fe6</entry>
Oct 26 09:33:54 user nova-compute[74075]:       <entry name="uuid">8b522482-66ab-4ae4-b851-9e4b74433fe6</entry>
Oct 26 09:33:54 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:33:54 user nova-compute[74075]:     </system>
Oct 26 09:33:54 user nova-compute[74075]:   </sysinfo>
Oct 26 09:33:54 user nova-compute[74075]:   <os>
Oct 26 09:33:54 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:33:54 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:33:54 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:33:54 user nova-compute[74075]:   </os>
Oct 26 09:33:54 user nova-compute[74075]:   <features>
Oct 26 09:33:54 user nova-compute[74075]:     <acpi/>
Oct 26 09:33:54 user nova-compute[74075]:     <apic/>
Oct 26 09:33:54 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:33:54 user nova-compute[74075]:   </features>
Oct 26 09:33:54 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:33:54 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:33:54 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:33:54 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:33:54 user nova-compute[74075]:   </clock>
Oct 26 09:33:54 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:33:54 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:33:54 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:33:54 user nova-compute[74075]:   </cpu>
Oct 26 09:33:54 user nova-compute[74075]:   <devices>
Oct 26 09:33:54 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:33:54 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:33:54 user nova-compute[74075]:       <source dev="/dev/sdc"/>
Oct 26 09:33:54 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:33:54 user nova-compute[74075]:       <serial>4a945ccc-dbb8-4338-84ee-d7d247be53f2</serial>
Oct 26 09:33:54 user nova-compute[74075]:     </disk>
Oct 26 09:33:54 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:54 user nova-compute[74075]:       <mac address="fa:16:3e:ff:da:f9"/>
Oct 26 09:33:54 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:54 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:54 user nova-compute[74075]:       <target dev="tap06454434-82"/>
Oct 26 09:33:54 user nova-compute[74075]:     </interface>
Oct 26 09:33:54 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:33:54 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/console.log" append="off"/>
Oct 26 09:33:54 user nova-compute[74075]:     </serial>
Oct 26 09:33:54 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:33:54 user nova-compute[74075]:     <video>
Oct 26 09:33:54 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:54 user nova-compute[74075]:     </video>
Oct 26 09:33:54 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:33:54 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:33:54 user nova-compute[74075]:     </rng>
Oct 26 09:33:54 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:33:54 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:33:54 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:33:54 user nova-compute[74075]:     </memballoon>
Oct 26 09:33:54 user nova-compute[74075]:   </devices>
Oct 26 09:33:54 user nova-compute[74075]: </domain>
Oct 26 09:33:54 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-192025782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-192025782',id=20,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-lxucicnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:33:00Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=8b522482-66ab-4ae4-b851-9e4b74433fe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_vif [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[426cff65-0017-4696-934b-9c9469916679]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bab8b69-c7ed-5711-836d-557b586eb1cc', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06454434-82, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06454434-82, col_values=(('qos', UUID('3210e7b3-2daa-4cba-9a3a-9e65407c34a2')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06454434-82, col_values=(('external_ids', {'iface-id': '06454434-823c-4a71-a950-ff140c5e2003', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:da:f9', 'vm-uuid': '8b522482-66ab-4ae4-b851-9e4b74433fe6'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebe847-d31d-4968-9822-5970eb4ca009]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMdfZUKm {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:54 user nova-compute[74075]: INFO os_vif [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82')
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMdfZUKm" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf0cd7-0c17-4106-86af-6cff7df50c43]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMdfZUKm'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb8e586-17e5-4c5e-acaf-d7cbdf66f511]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7723cf2-97a3-4470-855f-a9b5744f5ed3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No VIF found with MAC fa:16:3e:ff:da:f9, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e2822-b021-4cfe-9645-598263a0711f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260]
Oct 26 09:33:54 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260] successful.
Oct 26 09:33:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[da042779-0c71-4710-ba7a-1ce4c608fbb4]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3174c-6313-43b4-bd68-2216dabd2493]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:33:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[594ab91e-d91d-4679-9fcf-83a8a2508e56]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:54 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdfZUKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== connect_volume: return (2604ms) {'type': 'block', 'scsi_wwn': '23035323466616432', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035323466616432', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnITpuAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:33:55 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:55 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:33:55 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee711bb-16d3-448f-a143-7fa8064b8710]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:33:55 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997522d-cb93-4f00-9cf9-f03eee4c1cfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31] added
Oct 26 09:33:55 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92f7c0f-6536-4501-96c1-225efea844c9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f858921-455b-421f-9c2b-e8d36f1afd86]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnITpuAQ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnITpuAQ" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b878d6b-f7bd-41c1-b46f-dbcc169c25c1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnITpuAQ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d332f83-5177-4f27-89a8-d6cf967e775d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2127b7-2b2a-4f0f-a77f-4f8b887dc06a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ba05a-99b6-432d-b584-baea3dd36234]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260]
Oct 26 09:33:55 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260] successful.
Oct 26 09:33:55 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac9c6bb-a7f4-40ee-919e-3c06274d76a1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b016907-d2d9-4849-a625-8eeb4b3a2276]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:33:55 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbec923-18ea-4925-9a8f-3464abad893a]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnITpuAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-80aacfd3-00cf-42a7-bf26-c8a0309e86ca req-60a85264-a624-41a8-81f4-3aca11193f49 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-80aacfd3-00cf-42a7-bf26-c8a0309e86ca req-60a85264-a624-41a8-81f4-3aca11193f49 service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-80aacfd3-00cf-42a7-bf26-c8a0309e86ca req-60a85264-a624-41a8-81f4-3aca11193f49 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-80aacfd3-00cf-42a7-bf26-c8a0309e86ca req-60a85264-a624-41a8-81f4-3aca11193f49 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-80aacfd3-00cf-42a7-bf26-c8a0309e86ca req-60a85264-a624-41a8-81f4-3aca11193f49 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:33:55 user nova-compute[74075]: WARNING nova.compute.manager [req-80aacfd3-00cf-42a7-bf26-c8a0309e86ca req-60a85264-a624-41a8-81f4-3aca11193f49 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state building and task_state spawning.
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23561356536373739', 'path': '/dev/sde'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561356536373739', 'path': '/dev/sde'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lazy-loading 'pci_devices' on Instance uuid c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:33:56 user nova-compute[74075]:   <uuid>c8d17aaf-95c6-49bd-9fdc-92c11cf5a764</uuid>
Oct 26 09:33:56 user nova-compute[74075]:   <name>instance-0000000e</name>
Oct 26 09:33:56 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:33:56 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:33:56 user nova-compute[74075]:   <metadata>
Oct 26 09:33:56 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:33:56 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:33:56 user nova-compute[74075]:       <nova:name>tempest-device-tagging-server-1234318581</nova:name>
Oct 26 09:33:56 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:33:51</nova:creationTime>
Oct 26 09:33:56 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:33:56 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:33:56 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:33:56 user nova-compute[74075]:       <nova:owner>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:user uuid="bd20a1bbfb05446ea7d8784eddf7ae87">tempest-TaggedBootDevicesTest-720471860-project-member</nova:user>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:project uuid="2ce8f02598ef4a1e9e6a82aaabf3c2d4">tempest-TaggedBootDevicesTest-720471860</nova:project>
Oct 26 09:33:56 user nova-compute[74075]:       </nova:owner>
Oct 26 09:33:56 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:33:56 user nova-compute[74075]:       <nova:ports>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="709d9d2f-c9de-4e69-b9c6-d201733cc02d">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="3f64d03b-372c-4542-b961-677277da707c">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="28abc9fa-723e-4cf8-9bcb-3bd8176a2652">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="a9e70323-2071-44ca-94d4-4bbffea7a52c">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="c20fd7fa-c78a-49cb-aa40-c5ac23dd947e">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="c602d44f-e69e-45fc-819d-f42d44d4de72">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:         <nova:port uuid="ecda9578-a8c4-44e5-8fd8-dde526552ba0">
Oct 26 09:33:56 user nova-compute[74075]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 09:33:56 user nova-compute[74075]:         </nova:port>
Oct 26 09:33:56 user nova-compute[74075]:       </nova:ports>
Oct 26 09:33:56 user nova-compute[74075]:     </nova:instance>
Oct 26 09:33:56 user nova-compute[74075]:   </metadata>
Oct 26 09:33:56 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:33:56 user nova-compute[74075]:     <system>
Oct 26 09:33:56 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:33:56 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:33:56 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:33:56 user nova-compute[74075]:       <entry name="serial">c8d17aaf-95c6-49bd-9fdc-92c11cf5a764</entry>
Oct 26 09:33:56 user nova-compute[74075]:       <entry name="uuid">c8d17aaf-95c6-49bd-9fdc-92c11cf5a764</entry>
Oct 26 09:33:56 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:33:56 user nova-compute[74075]:     </system>
Oct 26 09:33:56 user nova-compute[74075]:   </sysinfo>
Oct 26 09:33:56 user nova-compute[74075]:   <os>
Oct 26 09:33:56 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:33:56 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:33:56 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:33:56 user nova-compute[74075]:   </os>
Oct 26 09:33:56 user nova-compute[74075]:   <features>
Oct 26 09:33:56 user nova-compute[74075]:     <acpi/>
Oct 26 09:33:56 user nova-compute[74075]:     <apic/>
Oct 26 09:33:56 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:33:56 user nova-compute[74075]:   </features>
Oct 26 09:33:56 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:33:56 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:33:56 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:33:56 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:33:56 user nova-compute[74075]:   </clock>
Oct 26 09:33:56 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:33:56 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:33:56 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:33:56 user nova-compute[74075]:   </cpu>
Oct 26 09:33:56 user nova-compute[74075]:   <devices>
Oct 26 09:33:56 user nova-compute[74075]:     <disk type="file" device="cdrom">
Oct 26 09:33:56 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 09:33:56 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764/disk.config"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="hda" bus="ide"/>
Oct 26 09:33:56 user nova-compute[74075]:     </disk>
Oct 26 09:33:56 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:33:56 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:33:56 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <serial>6922b977-39aa-40c8-96e3-f722ccf6f275</serial>
Oct 26 09:33:56 user nova-compute[74075]:     </disk>
Oct 26 09:33:56 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:33:56 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:33:56 user nova-compute[74075]:       <source dev="/dev/sdd"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <serial>b9d429dd-394a-43d1-94ad-48a5feff4663</serial>
Oct 26 09:33:56 user nova-compute[74075]:     </disk>
Oct 26 09:33:56 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:33:56 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:33:56 user nova-compute[74075]:       <source dev="/dev/sde"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="vdc" bus="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <serial>bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31</serial>
Oct 26 09:33:56 user nova-compute[74075]:     </disk>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:bc:23:b5"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tap709d9d2f-c9"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:b7:33:77"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tap3f64d03b-37"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:f6:f3:4a"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tap28abc9fa-72"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:40:72:a6"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tapa9e70323-20"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:c1:57:c8"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tapc20fd7fa-c7"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:e4:5d:5e"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tapc602d44f-e6"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:33:56 user nova-compute[74075]:       <mac address="fa:16:3e:d3:07:79"/>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:33:56 user nova-compute[74075]:       <target dev="tapecda9578-a8"/>
Oct 26 09:33:56 user nova-compute[74075]:     </interface>
Oct 26 09:33:56 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:33:56 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764/console.log" append="off"/>
Oct 26 09:33:56 user nova-compute[74075]:     </serial>
Oct 26 09:33:56 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:33:56 user nova-compute[74075]:     <video>
Oct 26 09:33:56 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:33:56 user nova-compute[74075]:     </video>
Oct 26 09:33:56 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:33:56 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:33:56 user nova-compute[74075]:     </rng>
Oct 26 09:33:56 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:33:56 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:33:56 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:33:56 user nova-compute[74075]:     </memballoon>
Oct 26 09:33:56 user nova-compute[74075]:   </devices>
Oct 26 09:33:56 user nova-compute[74075]: </domain>
Oct 26 09:33:56 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70e03413-5cc3-540e-b44f-44653966ff83', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap709d9d2f-c9, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap709d9d2f-c9, col_values=(('qos', UUID('3ef0f292-7c3b-466e-ad37-453b6653b25c')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap709d9d2f-c9, col_values=(('external_ids', {'iface-id': '709d9d2f-c9de-4e69-b9c6-d201733cc02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:23:b5', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6b123fc-a6b9-5b78-a09f-21c9c5e1445b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f64d03b-37, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f64d03b-37, col_values=(('qos', UUID('82db6428-cff4-41b1-8370-5477e0e4f790')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f64d03b-37, col_values=(('external_ids', {'iface-id': '3f64d03b-372c-4542-b961-677277da707c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:33:77', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '912f91ea-ba19-5384-a0b1-72b9c81e5677', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28abc9fa-72, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28abc9fa-72, col_values=(('qos', UUID('31c823b8-10a7-41cc-96e0-bd0dd11c4890')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28abc9fa-72, col_values=(('external_ids', {'iface-id': '28abc9fa-723e-4cf8-9bcb-3bd8176a2652', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:f3:4a', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb32c66b-c45a-5ccd-8a2c-c4ea36b2229a', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9e70323-20, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9e70323-20, col_values=(('qos', UUID('d4e0174f-c347-4662-8749-8111e4ec308b')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9e70323-20, col_values=(('external_ids', {'iface-id': 'a9e70323-2071-44ca-94d4-4bbffea7a52c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:72:a6', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f3669c6-e634-5f84-8524-e269bf0e1cfe', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc20fd7fa-c7, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc20fd7fa-c7, col_values=(('qos', UUID('dabf1b77-1770-4e73-a557-71a0964849fd')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc20fd7fa-c7, col_values=(('external_ids', {'iface-id': 'c20fd7fa-c78a-49cb-aa40-c5ac23dd947e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:57:c8', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a420b0af-7351-528a-9657-90da9839a638', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc602d44f-e6, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc602d44f-e6, col_values=(('qos', UUID('3f975f01-e979-4122-b537-8a1a912c5109')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc602d44f-e6, col_values=(('external_ids', {'iface-id': 'c602d44f-e69e-45fc-819d-f42d44d4de72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:5d:5e', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c04ecd0-5edb-56a1-9d59-c04b3bac72ac', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecda9578-a8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecda9578-a8, col_values=(('qos', UUID('83d4edc5-1c99-477f-bbb9-cad943ed14fd')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecda9578-a8, col_values=(('external_ids', {'iface-id': 'ecda9578-a8c4-44e5-8fd8-dde526552ba0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:07:79', 'vm-uuid': 'c8d17aaf-95c6-49bd-9fdc-92c11cf5a764'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:57 user nova-compute[74075]: INFO os_vif [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8')
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] No BDM found with device name hda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] No VIF found with MAC fa:16:3e:bc:23:b5, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] No VIF found with MAC fa:16:3e:c1:57:c8, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:33:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Using config drive
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:33:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance spawned successfully.
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:57 user nova-compute[74075]: INFO nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Took 6.51 seconds to spawn the instance on the hypervisor.
Oct 26 09:33:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:33:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Creating config drive at /opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764/disk.config
Oct 26 09:33:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm838zlz4 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-c2f1cf9e-aed3-4cbd-b413-e893a8436dc7 req-5bc0ae8c-586f-4ff3-8ed4-ea774a7f528e service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c2f1cf9e-aed3-4cbd-b413-e893a8436dc7 req-5bc0ae8c-586f-4ff3-8ed4-ea774a7f528e service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c2f1cf9e-aed3-4cbd-b413-e893a8436dc7 req-5bc0ae8c-586f-4ff3-8ed4-ea774a7f528e service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c2f1cf9e-aed3-4cbd-b413-e893a8436dc7 req-5bc0ae8c-586f-4ff3-8ed4-ea774a7f528e service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-c2f1cf9e-aed3-4cbd-b413-e893a8436dc7 req-5bc0ae8c-586f-4ff3-8ed4-ea774a7f528e service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:33:58 user nova-compute[74075]: WARNING nova.compute.manager [req-c2f1cf9e-aed3-4cbd-b413-e893a8436dc7 req-5bc0ae8c-586f-4ff3-8ed4-ea774a7f528e service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state building and task_state spawning.
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm838zlz4" returned: 0 in 0.060s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:58 user nova-compute[74075]: INFO nova.compute.manager [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Took 58.90 seconds to build instance.
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6920852b-a9ab-48bd-9713-e49bda5ca683 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 59.082s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:00 user nova-compute[74075]: WARNING nova.compute.manager [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d for instance with vm_state building and task_state spawning.
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:00 user nova-compute[74075]: WARNING nova.compute.manager [req-362a3599-2adb-4563-92fd-dcaf72adc774 req-fa0257d6-9f86-4658-a663-24c5b0540387 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d for instance with vm_state building and task_state spawning.
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-4e10ddf6-b193-4567-ad3b-341719144d30 req-dc7512e4-b04f-4548-b6d0-8512363951ad service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4e10ddf6-b193-4567-ad3b-341719144d30 req-dc7512e4-b04f-4548-b6d0-8512363951ad service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4e10ddf6-b193-4567-ad3b-341719144d30 req-dc7512e4-b04f-4548-b6d0-8512363951ad service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4e10ddf6-b193-4567-ad3b-341719144d30 req-dc7512e4-b04f-4548-b6d0-8512363951ad service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-4e10ddf6-b193-4567-ad3b-341719144d30 req-dc7512e4-b04f-4548-b6d0-8512363951ad service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:00 user nova-compute[74075]: WARNING nova.compute.manager [req-4e10ddf6-b193-4567-ad3b-341719144d30 req-dc7512e4-b04f-4548-b6d0-8512363951ad service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 for instance with vm_state building and task_state spawning.
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-a69cca54-d843-4106-9582-6188176eb8e6 req-b6327c61-9601-41b8-b1cd-699f556ebe8a service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.compute.manager [req-3b9591f0-4abe-48c6-8a50-02298aa79897 req-e45c8d19-e866-488e-a21c-a9fb130d3558 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 for instance with vm_state building and task_state spawning.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:34:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance spawned successfully.
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:34:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7309MB free_disk=25.404232025146484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance e4baa273-79c9-408c-9c41-17e202582246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dc06e7b9-860e-4ba3-8918-9b2f9dc21856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b51b900c-8776-4654-8acd-4d406a5ed7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:34:04 user nova-compute[74075]: INFO nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Took 12.74 seconds to spawn the instance on the hypervisor.
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:34:04 user nova-compute[74075]: INFO nova.compute.manager [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Took 197.95 seconds to build instance.
Oct 26 09:34:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fd4545d-3e75-49b9-a64b-b2e0acbf73ee tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 198.398s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:34:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:34:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:19 user nova-compute[74075]: INFO nova.compute.manager [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Terminating instance
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-d362e7f5-8ec5-4909-ad6b-703e633dd6d1 req-a73a8c4f-243d-4283-99ed-dbf6afb58467 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-vif-unplugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d362e7f5-8ec5-4909-ad6b-703e633dd6d1 req-a73a8c4f-243d-4283-99ed-dbf6afb58467 service nova] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d362e7f5-8ec5-4909-ad6b-703e633dd6d1 req-a73a8c4f-243d-4283-99ed-dbf6afb58467 service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d362e7f5-8ec5-4909-ad6b-703e633dd6d1 req-a73a8c4f-243d-4283-99ed-dbf6afb58467 service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-d362e7f5-8ec5-4909-ad6b-703e633dd6d1 req-a73a8c4f-243d-4283-99ed-dbf6afb58467 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] No waiting events found dispatching network-vif-unplugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-d362e7f5-8ec5-4909-ad6b-703e633dd6d1 req-a73a8c4f-243d-4283-99ed-dbf6afb58467 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-vif-unplugged-bf16784b-a487-416e-ab92-00e783953c22 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Instance destroyed successfully.
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lazy-loading 'resources' on Instance uuid dc06e7b9-860e-4ba3-8918-9b2f9dc21856 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1329854133',display_name='tempest-ServersNegativeTestJSON-server-1329854133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1329854133',id=17,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:32:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d989d010e8bf4fcabfc7f5109432fa29',ramdisk_id='',reservation_id='r-04dra1nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2029109923',owner_user_name='tempest-ServersNegativeTestJSON-2029109923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:32:35Z,user_data=None,user_id='72e41eeb99a44dde89e0c8530c4c3dbd',uuid=dc06e7b9-860e-4ba3-8918-9b2f9dc21856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converting VIF {"id": "bf16784b-a487-416e-ab92-00e783953c22", "address": "fa:16:3e:57:22:8b", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf16784b-a4", "ovs_interfaceid": "bf16784b-a487-416e-ab92-00e783953c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG os_vif [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf16784b-a4, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a793336b-d734-49ca-a4af-57d572dbb657) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:19 user nova-compute[74075]: INFO os_vif [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=bf16784b-a487-416e-ab92-00e783953c22,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf16784b-a4')
Oct 26 09:34:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Deleting instance files /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856_del
Oct 26 09:34:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Deletion of /opt/stack/data/nova/instances/dc06e7b9-860e-4ba3-8918-9b2f9dc21856_del complete
Oct 26 09:34:19 user nova-compute[74075]: INFO nova.compute.manager [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 26 09:34:19 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:34:19 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:34:20 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Took 0.65 seconds to deallocate network for instance.
Oct 26 09:34:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a2fcc89b-0641-43ac-8381-01076926ebd5 req-6bed7602-5b5a-437b-9a73-b96f99b27f25 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-vif-deleted-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:20 user nova-compute[74075]: INFO nova.compute.manager [req-a2fcc89b-0641-43ac-8381-01076926ebd5 req-6bed7602-5b5a-437b-9a73-b96f99b27f25 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Neutron deleted interface bf16784b-a487-416e-ab92-00e783953c22; detaching it from the instance and deleting it from the info cache
Oct 26 09:34:20 user nova-compute[74075]: DEBUG nova.network.neutron [req-a2fcc89b-0641-43ac-8381-01076926ebd5 req-6bed7602-5b5a-437b-9a73-b96f99b27f25 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a2fcc89b-0641-43ac-8381-01076926ebd5 req-6bed7602-5b5a-437b-9a73-b96f99b27f25 service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Detach interface failed, port_id=bf16784b-a487-416e-ab92-00e783953c22, reason: Instance dc06e7b9-860e-4ba3-8918-9b2f9dc21856 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:34:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:20 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Deleted allocations for instance dc06e7b9-860e-4ba3-8918-9b2f9dc21856
Oct 26 09:34:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ee657d1c-0c00-46bb-8d05-3de39149bd10 tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.909s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-2ce501c2-08ca-45ec-93d4-b82b41c54118 req-37cc6428-5fda-404c-81f7-241c9be538fd service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received event network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2ce501c2-08ca-45ec-93d4-b82b41c54118 req-37cc6428-5fda-404c-81f7-241c9be538fd service nova] Acquiring lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2ce501c2-08ca-45ec-93d4-b82b41c54118 req-37cc6428-5fda-404c-81f7-241c9be538fd service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2ce501c2-08ca-45ec-93d4-b82b41c54118 req-37cc6428-5fda-404c-81f7-241c9be538fd service nova] Lock "dc06e7b9-860e-4ba3-8918-9b2f9dc21856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-2ce501c2-08ca-45ec-93d4-b82b41c54118 req-37cc6428-5fda-404c-81f7-241c9be538fd service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] No waiting events found dispatching network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:21 user nova-compute[74075]: WARNING nova.compute.manager [req-2ce501c2-08ca-45ec-93d4-b82b41c54118 req-37cc6428-5fda-404c-81f7-241c9be538fd service nova] [instance: dc06e7b9-860e-4ba3-8918-9b2f9dc21856] Received unexpected event network-vif-plugged-bf16784b-a487-416e-ab92-00e783953c22 for instance with vm_state deleted and task_state None.
Oct 26 09:34:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:38 user nova-compute[74075]: INFO nova.compute.manager [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Terminating instance
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ef84366-3ffc-46a9-acff-0d62f6b41b94 req-35392ba9-9539-4b96-8ebd-a0ef77b62b70 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ef84366-3ffc-46a9-acff-0d62f6b41b94 req-35392ba9-9539-4b96-8ebd-a0ef77b62b70 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ef84366-3ffc-46a9-acff-0d62f6b41b94 req-35392ba9-9539-4b96-8ebd-a0ef77b62b70 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ef84366-3ffc-46a9-acff-0d62f6b41b94 req-35392ba9-9539-4b96-8ebd-a0ef77b62b70 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ef84366-3ffc-46a9-acff-0d62f6b41b94 req-35392ba9-9539-4b96-8ebd-a0ef77b62b70 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ef84366-3ffc-46a9-acff-0d62f6b41b94 req-35392ba9-9539-4b96-8ebd-a0ef77b62b70 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-unplugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:34:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Instance destroyed successfully.
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'resources' on Instance uuid e4baa273-79c9-408c-9c41-17e202582246 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650728468',display_name='tempest-AttachVolumeTestJSON-server-650728468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650728468',id=4,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3GbVMAdD9evfq32Q2pGFFzu3tdpaUZHhGfx1FBc/6yBfXJF1HjzKwzJz98IOHTnX+XkBj9+el1SY+BgROlaIfbBSjmS7tSSs8MoFIB2KFu5th8ORuCZeZH11WDapMZlg==',key_name='tempest-keypair-2055628221',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-zd3ufqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=e4baa273-79c9-408c-9c41-17e202582246,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "address": "fa:16:3e:b5:b5:5b", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf845ec-94", "ovs_interfaceid": "bbf845ec-94f6-4489-a12d-2bc5cca19e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG os_vif [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbf845ec-94, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67d527d4-cd0e-46b1-b400-f63934118224) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:38 user nova-compute[74075]: INFO os_vif [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b5:5b,bridge_name='br-int',has_traffic_filtering=True,id=bbf845ec-94f6-4489-a12d-2bc5cca19e8a,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbf845ec-94')
Oct 26 09:34:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Deleting instance files /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246_del
Oct 26 09:34:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Deletion of /opt/stack/data/nova/instances/e4baa273-79c9-408c-9c41-17e202582246_del complete
Oct 26 09:34:38 user nova-compute[74075]: INFO nova.compute.manager [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: e4baa273-79c9-408c-9c41-17e202582246] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 26 09:34:38 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:34:38 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:34:39 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:34:39 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: e4baa273-79c9-408c-9c41-17e202582246] Took 0.96 seconds to deallocate network for instance.
Oct 26 09:34:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-800a5440-c7ab-49ac-806e-eff73ea67b31 req-0b122afe-c06c-4f77-b0e3-8aa796140b20 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-deleted-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:40 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Deleted allocations for instance e4baa273-79c9-408c-9c41-17e202582246
Oct 26 09:34:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d85c91b1-7355-47ed-8137-347279d63fdf tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "e4baa273-79c9-408c-9c41-17e202582246" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-95dc9143-b187-4a6f-b17a-a32cabd21131 req-67843d0a-32f3-4d89-9cbc-ffb978876366 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95dc9143-b187-4a6f-b17a-a32cabd21131 req-67843d0a-32f3-4d89-9cbc-ffb978876366 service nova] Acquiring lock "e4baa273-79c9-408c-9c41-17e202582246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95dc9143-b187-4a6f-b17a-a32cabd21131 req-67843d0a-32f3-4d89-9cbc-ffb978876366 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95dc9143-b187-4a6f-b17a-a32cabd21131 req-67843d0a-32f3-4d89-9cbc-ffb978876366 service nova] Lock "e4baa273-79c9-408c-9c41-17e202582246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-95dc9143-b187-4a6f-b17a-a32cabd21131 req-67843d0a-32f3-4d89-9cbc-ffb978876366 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] No waiting events found dispatching network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:34:40 user nova-compute[74075]: WARNING nova.compute.manager [req-95dc9143-b187-4a6f-b17a-a32cabd21131 req-67843d0a-32f3-4d89-9cbc-ffb978876366 service nova] [instance: e4baa273-79c9-408c-9c41-17e202582246] Received unexpected event network-vif-plugged-bbf845ec-94f6-4489-a12d-2bc5cca19e8a for instance with vm_state deleted and task_state None.
Oct 26 09:34:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-changed-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Refreshing instance network info cache due to event network-changed-679c010d-71ce-4729-89bf-c3e242b330a6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] Acquiring lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] Acquired lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Refreshing network info cache for port 679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updated VIF entry in instance network info cache for port 679c010d-71ce-4729-89bf-c3e242b330a6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updating instance_info_cache with network_info: [{"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:34:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1136a616-c7be-4a72-bd59-05da8810eb7b req-b0e18195-137d-4835-9ea0-3c95104b89a8 service nova] Releasing lock "refresh_cache-fccf2eec-a34b-47bc-bbc4-0369faf87a9c" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'flavor' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:43 user nova-compute[74075]: INFO nova.compute.manager [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Attaching volume 81752223-8cd9-4a38-a8e3-a29b36b64526 to /dev/vdb
Oct 26 09:34:43 user nova-compute[74075]: DEBUG os_brick.utils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad291e44-e248-4c53-ae53-6924c779d31a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e434ff8-7515-4be5-adbe-7ba8f1ca9a24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cb01ba-2295-4124-89ca-9b0c8cbe6866]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3a8e7-85b4-4702-a8a6-f2a2bad64d4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:34:43 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:34:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c216e87d-3d43-42e9-aa04-6897fd9ea873]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG os_brick.utils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating existing volume attachment record: ca88881d-5c6c-427a-b154-ce541049e9dc {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:34:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing instance network info cache due to event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updated VIF entry in instance network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:34:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e81aa9b3-3a08-4aa6-b6a7-a98ee0adfdf1 req-9d44c4de-10df-4d3f-b3cd-f2bf582e6447 service nova] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG nova.objects.instance [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid fccf2eec-a34b-47bc-bbc4-0369faf87a9c {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:46 user nova-compute[74075]: INFO nova.compute.manager [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Attaching volume 20d11606-8073-43a6-b23c-dcf287e9033d to /dev/vdb
Oct 26 09:34:46 user nova-compute[74075]: DEBUG os_brick.utils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1603890-9485-4563-b749-6a00f85f0c1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e726b1-3d7c-408d-adef-91c56f19d411]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[468065b3-dea3-44e4-87be-f53dfc02ad58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df42916-b598-4ae6-85a6-8722b9bf3e8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:34:46 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:34:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93155b-4724-4de9-8e06-2219b75c568a]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:34:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:34:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:34:47 user nova-compute[74075]: DEBUG os_brick.utils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:34:47 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updating existing volume attachment record: 747f1265-1ac4-49e3-a835-19419f0b22c5 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:34:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:34:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:34:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lazy-loading 'flavor' on Instance uuid b51b900c-8776-4654-8acd-4d406a5ed7b9 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:56 user nova-compute[74075]: INFO nova.compute.manager [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Attaching volume 6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 to /dev/vdb
Oct 26 09:34:56 user nova-compute[74075]: DEBUG os_brick.utils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[202331b9-072f-45bc-8a70-2e81ff60004e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae44810-38d8-4201-8ad7-f0205e036ba5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3842eb4b-41bf-4450-9b14-df7f342863b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a965fe37-2fef-476e-b012-4640bed43964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:34:56 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:34:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7075c6-c7dd-49e4-a63e-e4b1f52a504d]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG os_brick.utils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:34:56 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Updating existing volume attachment record: c148e0d8-caa1-4aa2-8c3c-ae1c32e7cdc0 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updating instance_info_cache with network_info: [{"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:34:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7572MB free_disk=25.456439971923828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b51b900c-8776-4654-8acd-4d406a5ed7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrHufNsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:02 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05cf00b-07a1-4c9b-a94a-b87e71f47239]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:35:02 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[69924f65-5667-4bc5-933f-b1ede4c67216]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526] added
Oct 26 09:35:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20bf81b-9e18-4cda-bc27-6a68b548516b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e1183-404f-443c-b39a-0114f22e391e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrHufNsG {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrHufNsG" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf1553-8acb-41d9-8844-c8462ccc1463]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrHufNsG'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b753574-e698-4a79-bf04-589e253db427]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc092e6f-bff9-4227-9034-be6520ff4f82]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.833s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a477e-2119-4624-8776-90ca5a96e737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260]
Oct 26 09:35:03 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d4897c-3166-4c68-b62c-5cd3e27fd55b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9109c0-9564-4dc2-8a3d-dc60cb93525a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8823a1-467d-4193-867a-c0c2dc6de105]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'flavor' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:03 user nova-compute[74075]: INFO nova.compute.manager [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Attaching volume 5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d to /dev/vdb
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.utils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd98aa8b-ee99-41eb-9b07-d47b9b0be809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb9ff0-c601-4af4-9691-48ad81bd8e1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f222d1-fc12-4ab4-a548-c7efc5b0a3d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fea7c5-4ad2-4a8b-b1c6-9b9b16b318f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:35:03 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:35:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db33395-09ce-4ce4-802c-3a5d283510cf]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG os_brick.utils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating existing volume attachment record: 54a97c04-0e5d-4b3a-9ff4-a030b8775413 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:35:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrHufNsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23338343431636163', 'path': '/dev/sdf'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338343431636163', 'path': '/dev/sdf'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'flavor' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:35:04 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:35:04 user nova-compute[74075]:   <source dev="/dev/sdf"/>
Oct 26 09:35:04 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:35:04 user nova-compute[74075]:   <serial>81752223-8cd9-4a38-a8e3-a29b36b64526</serial>
Oct 26 09:35:04 user nova-compute[74075]: </disk>
Oct 26 09:35:04 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:a2:8a:17, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EecnsMpl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:06 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:06 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:06 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93c8e72-58fc-40e4-9589-d78f03814d19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:35:06 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e324961-1c64-4c94-b8f8-5d15981c8b8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d] added
Oct 26 09:35:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[29658aa3-945f-42e8-9354-9b41908089a2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6593e64c-e231-4f22-8168-4ad9d3017e64]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EecnsMpl {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EecnsMpl" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6931f3-d9e4-4a3d-a292-ac8422e7d209]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EecnsMpl'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea52665-24a9-46fc-8485-a4b930ad6234]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2cee4-d0c1-4fc6-b719-b65c73d50c81]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:35:06 user nova-compute[74075]: INFO nova.compute.claims [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Claim successful on node user
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3fa481-d8fc-4b83-a354-eb680b4fee11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260]
Oct 26 09:35:06 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd271c78-7b89-4738-9795-df566f572ed0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8206d413-f8e7-4b97-96ba-fcba6ca11e25]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:06 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b449acf-0fbd-48cd-a359-fed45432019d]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EecnsMpl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0de575e-2377-4190-837c-d26e2141ea90 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.191s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:06 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:35:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.policy [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '729f5d24fc714c65b3c1a811e5cdf271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a627b8e169d4a97b075f16e150d972f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:35:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Creating image(s)
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.216s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23733653766663364', 'path': '/dev/sdg'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653766663364', 'path': '/dev/sdg'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.objects.instance [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid fccf2eec-a34b-47bc-bbc4-0369faf87a9c {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk 1073741824" returned: 0 in 0.063s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:35:07 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:35:07 user nova-compute[74075]:   <source dev="/dev/sdg"/>
Oct 26 09:35:07 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:35:07 user nova-compute[74075]:   <serial>20d11606-8073-43a6-b23c-dcf287e9033d</serial>
Oct 26 09:35:07 user nova-compute[74075]: </disk>
Oct 26 09:35:07 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:35:07 user nova-compute[74075]: INFO nova.compute.manager [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Rescuing
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Cannot resize image /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Ensure instance console log exists: /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:a8:65:9c, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Successfully created port: 46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-1b887000-0d52-4dc6-8f91-064936b11bc9 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.602s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Successfully updated port: 46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquired lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-changed-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Refreshing instance network info cache due to event network-changed-46466255-14c7-44ca-a9f2-ba113a2f6c7b. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] Acquiring lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-e5543d48-0708-455c-afdc-bd322cf27681 req-08d4fd26-c250-4380-9e76-5fbd11eac448 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e5543d48-0708-455c-afdc-bd322cf27681 req-08d4fd26-c250-4380-9e76-5fbd11eac448 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e5543d48-0708-455c-afdc-bd322cf27681 req-08d4fd26-c250-4380-9e76-5fbd11eac448 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e5543d48-0708-455c-afdc-bd322cf27681 req-08d4fd26-c250-4380-9e76-5fbd11eac448 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-e5543d48-0708-455c-afdc-bd322cf27681 req-08d4fd26-c250-4380-9e76-5fbd11eac448 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:09 user nova-compute[74075]: WARNING nova.compute.manager [req-e5543d48-0708-455c-afdc-bd322cf27681 req-08d4fd26-c250-4380-9e76-5fbd11eac448 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:09 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance destroyed successfully.
Oct 26 09:35:09 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Attempting rescue
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74075) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:35:09 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Creating image(s)
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating instance_info_cache with network_info: [{"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Releasing lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance network_info: |[{"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] Acquired lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Refreshing network info cache for port 46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Start _get_guest_xml network_info=[{"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:35:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1030772267',display_name='tempest-tempest.common.compute-instance-1030772267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1030772267',id=22,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6XdemNGi/T5Swi6Qm1B3fJox8HXNlq/nDs38Q27usMWgV6OUZP35al+1l4dDaFCJXgrAfYAtM6lOZpqFR1UMG4mroKlQSfHltwkjm/4M85S8xOTkY77/EIN1bmQdtJw==',key_name='tempest-keypair-145721028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-ei5ackcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=1d69c28a-91cb-47b3-b58d-0391ff8029c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:35:09 user nova-compute[74075]:   <uuid>1d69c28a-91cb-47b3-b58d-0391ff8029c6</uuid>
Oct 26 09:35:09 user nova-compute[74075]:   <name>instance-00000016</name>
Oct 26 09:35:09 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:35:09 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:35:09 user nova-compute[74075]:   <metadata>
Oct 26 09:35:09 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:35:09 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:name>tempest-tempest.common.compute-instance-1030772267</nova:name>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:35:09</nova:creationTime>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:35:09 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:35:09 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:owner>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:user uuid="729f5d24fc714c65b3c1a811e5cdf271">tempest-ServerActionsTestOtherA-546437878-project-member</nova:user>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:project uuid="7a627b8e169d4a97b075f16e150d972f">tempest-ServerActionsTestOtherA-546437878</nova:project>
Oct 26 09:35:09 user nova-compute[74075]:       </nova:owner>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:ports>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:port uuid="46466255-14c7-44ca-a9f2-ba113a2f6c7b">
Oct 26 09:35:09 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:35:09 user nova-compute[74075]:         </nova:port>
Oct 26 09:35:09 user nova-compute[74075]:       </nova:ports>
Oct 26 09:35:09 user nova-compute[74075]:     </nova:instance>
Oct 26 09:35:09 user nova-compute[74075]:   </metadata>
Oct 26 09:35:09 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:35:09 user nova-compute[74075]:     <system>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="serial">1d69c28a-91cb-47b3-b58d-0391ff8029c6</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="uuid">1d69c28a-91cb-47b3-b58d-0391ff8029c6</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:35:09 user nova-compute[74075]:     </system>
Oct 26 09:35:09 user nova-compute[74075]:   </sysinfo>
Oct 26 09:35:09 user nova-compute[74075]:   <os>
Oct 26 09:35:09 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:35:09 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:35:09 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:35:09 user nova-compute[74075]:   </os>
Oct 26 09:35:09 user nova-compute[74075]:   <features>
Oct 26 09:35:09 user nova-compute[74075]:     <acpi/>
Oct 26 09:35:09 user nova-compute[74075]:     <apic/>
Oct 26 09:35:09 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:35:09 user nova-compute[74075]:   </features>
Oct 26 09:35:09 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:35:09 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:35:09 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:35:09 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:35:09 user nova-compute[74075]:   </clock>
Oct 26 09:35:09 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:35:09 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:35:09 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:35:09 user nova-compute[74075]:   </cpu>
Oct 26 09:35:09 user nova-compute[74075]:   <devices>
Oct 26 09:35:09 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:09 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:09 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk"/>
Oct 26 09:35:09 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:     </disk>
Oct 26 09:35:09 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:35:09 user nova-compute[74075]:       <mac address="fa:16:3e:00:07:6b"/>
Oct 26 09:35:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:35:09 user nova-compute[74075]:       <target dev="tap46466255-14"/>
Oct 26 09:35:09 user nova-compute[74075]:     </interface>
Oct 26 09:35:09 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:35:09 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/console.log" append="off"/>
Oct 26 09:35:09 user nova-compute[74075]:     </serial>
Oct 26 09:35:09 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:35:09 user nova-compute[74075]:     <video>
Oct 26 09:35:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:     </video>
Oct 26 09:35:09 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:35:09 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:35:09 user nova-compute[74075]:     </rng>
Oct 26 09:35:09 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:35:09 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:35:09 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:35:09 user nova-compute[74075]:     </memballoon>
Oct 26 09:35:09 user nova-compute[74075]:   </devices>
Oct 26 09:35:09 user nova-compute[74075]: </domain>
Oct 26 09:35:09 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1030772267',display_name='tempest-tempest.common.compute-instance-1030772267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1030772267',id=22,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6XdemNGi/T5Swi6Qm1B3fJox8HXNlq/nDs38Q27usMWgV6OUZP35al+1l4dDaFCJXgrAfYAtM6lOZpqFR1UMG4mroKlQSfHltwkjm/4M85S8xOTkY77/EIN1bmQdtJw==',key_name='tempest-keypair-145721028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-ei5ackcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=1d69c28a-91cb-47b3-b58d-0391ff8029c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG os_vif [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1e78d5-7b09-586a-bb99-3ae7deed493b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue" returned: 0 in 0.063s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'migration_context' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46466255-14, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46466255-14, col_values=(('qos', UUID('3cdf7643-faa3-4466-a64b-21fa4760d32b')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46466255-14, col_values=(('external_ids', {'iface-id': '46466255-14c7-44ca-a9f2-ba113a2f6c7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:07:6b', 'vm-uuid': '1d69c28a-91cb-47b3-b58d-0391ff8029c6'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.base [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<0ed7d017-b761-4efe-9cc6-995fac04dd58> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Start _get_guest_xml network_info=[{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:a2:8a:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'resources' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.base [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<0ed7d017-b761-4efe-9cc6-995fac04dd58> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:09 user nova-compute[74075]: INFO os_vif [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14')
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.base [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<0ed7d017-b761-4efe-9cc6-995fac04dd58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.base [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<0ed7d017-b761-4efe-9cc6-995fac04dd58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494371913',display_name='tempest-ServerRescueNegativeTestJSON-server-494371913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494371913',id=19,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx/2xyx2khvJf9M6jt2G8MvWCuIOewmaKhtW8HAYNr666l+pDtMz3sB09XwYzZiqd0p+4Axm5iL+qYQE1Uc0D1F9F7LDpKJqX9Q3xKXA/rYBzjnu9kIwZWHmgPAMkUxKA==',key_name='tempest-keypair-2032257308',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:33:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-6p8lgs3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d86b9184a1410db33192820885da0f',uuid=0ed7d017-b761-4efe-9cc6-995fac04dd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:a2:8a:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "vif_mac": "fa:16:3e:a2:8a:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No VIF found with MAC fa:16:3e:00:07:6b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.objects.base [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Object Instance<0ed7d017-b761-4efe-9cc6-995fac04dd58> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:35:09 user nova-compute[74075]:   <uuid>0ed7d017-b761-4efe-9cc6-995fac04dd58</uuid>
Oct 26 09:35:09 user nova-compute[74075]:   <name>instance-00000013</name>
Oct 26 09:35:09 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:35:09 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:35:09 user nova-compute[74075]:   <metadata>
Oct 26 09:35:09 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:35:09 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-494371913</nova:name>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:35:09</nova:creationTime>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:35:09 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:35:09 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:owner>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:user uuid="82d86b9184a1410db33192820885da0f">tempest-ServerRescueNegativeTestJSON-336149992-project-member</nova:user>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:project uuid="e453d88800e642b98d9b66dde5fe2e73">tempest-ServerRescueNegativeTestJSON-336149992</nova:project>
Oct 26 09:35:09 user nova-compute[74075]:       </nova:owner>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:35:09 user nova-compute[74075]:       <nova:ports>
Oct 26 09:35:09 user nova-compute[74075]:         <nova:port uuid="f1bec6c3-c88d-4e3e-bcea-b3f7eb728867">
Oct 26 09:35:09 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 09:35:09 user nova-compute[74075]:         </nova:port>
Oct 26 09:35:09 user nova-compute[74075]:       </nova:ports>
Oct 26 09:35:09 user nova-compute[74075]:     </nova:instance>
Oct 26 09:35:09 user nova-compute[74075]:   </metadata>
Oct 26 09:35:09 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:35:09 user nova-compute[74075]:     <system>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="serial">0ed7d017-b761-4efe-9cc6-995fac04dd58</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="uuid">0ed7d017-b761-4efe-9cc6-995fac04dd58</entry>
Oct 26 09:35:09 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:35:09 user nova-compute[74075]:     </system>
Oct 26 09:35:09 user nova-compute[74075]:   </sysinfo>
Oct 26 09:35:09 user nova-compute[74075]:   <os>
Oct 26 09:35:09 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:35:09 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:35:09 user nova-compute[74075]:   </os>
Oct 26 09:35:09 user nova-compute[74075]:   <features>
Oct 26 09:35:09 user nova-compute[74075]:     <acpi/>
Oct 26 09:35:09 user nova-compute[74075]:     <apic/>
Oct 26 09:35:09 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:35:09 user nova-compute[74075]:   </features>
Oct 26 09:35:09 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:35:09 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:35:09 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:35:09 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:35:09 user nova-compute[74075]:   </clock>
Oct 26 09:35:09 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:35:09 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:35:09 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:35:09 user nova-compute[74075]:   </cpu>
Oct 26 09:35:09 user nova-compute[74075]:   <devices>
Oct 26 09:35:09 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:09 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:09 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue"/>
Oct 26 09:35:09 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:     </disk>
Oct 26 09:35:09 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:09 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:09 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk"/>
Oct 26 09:35:09 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:     </disk>
Oct 26 09:35:09 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:35:09 user nova-compute[74075]:       <mac address="fa:16:3e:a2:8a:17"/>
Oct 26 09:35:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:35:09 user nova-compute[74075]:       <target dev="tapf1bec6c3-c8"/>
Oct 26 09:35:09 user nova-compute[74075]:     </interface>
Oct 26 09:35:09 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:35:09 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/console.log" append="off"/>
Oct 26 09:35:09 user nova-compute[74075]:     </serial>
Oct 26 09:35:09 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:35:09 user nova-compute[74075]:     <video>
Oct 26 09:35:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:09 user nova-compute[74075]:     </video>
Oct 26 09:35:09 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:35:09 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:35:09 user nova-compute[74075]:     </rng>
Oct 26 09:35:09 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:35:09 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:35:09 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:35:09 user nova-compute[74075]:     </memballoon>
Oct 26 09:35:09 user nova-compute[74075]:   </devices>
Oct 26 09:35:09 user nova-compute[74075]: </domain>
Oct 26 09:35:09 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:35:09 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance destroyed successfully.
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] No VIF found with MAC fa:16:3e:a2:8a:17, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updated VIF entry in instance network info cache for port 46466255-14c7-44ca-a9f2-ba113a2f6c7b. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:35:10 user nova-compute[74075]: DEBUG nova.network.neutron [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating instance_info_cache with network_info: [{"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-22daa1e8-4cea-434e-bbbf-ff8a11ed7540 req-f9e8d5b1-c996-4a95-90fe-2646e0406a1c service nova] Releasing lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-changed-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing instance network info cache due to event network-changed-709d9d2f-c9de-4e69-b9c6-d201733cc02d. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] Acquiring lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] Acquired lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Refreshing network info cache for port 709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updated VIF entry in instance network info cache for port 709d9d2f-c9de-4e69-b9c6-d201733cc02d. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [{"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:35:11 user nova-compute[74075]: INFO nova.compute.claims [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Claim successful on node user
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] Releasing lock "refresh_cache-c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:11 user nova-compute[74075]: WARNING nova.compute.manager [req-429f6d9f-eb6c-408f-8b4e-472f8297e63b req-6d47a056-d7cd-4f64-a341-fbd1012452e8 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:11 user nova-compute[74075]: INFO nova.compute.manager [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Terminating instance
Oct 26 09:35:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:35:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.network.neutron [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:35:12 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.policy [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7604ae732734f05aaa7aeebf8ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07b30415774466817048f8090437ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:35:12 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Creating image(s)
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-8a6db856-1218-4758-a471-3c764360d507 req-4298f969-5bcc-4e1f-855a-59ba4af687b5 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8a6db856-1218-4758-a471-3c764360d507 req-4298f969-5bcc-4e1f-855a-59ba4af687b5 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8a6db856-1218-4758-a471-3c764360d507 req-4298f969-5bcc-4e1f-855a-59ba4af687b5 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8a6db856-1218-4758-a471-3c764360d507 req-4298f969-5bcc-4e1f-855a-59ba4af687b5 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-8a6db856-1218-4758-a471-3c764360d507 req-4298f969-5bcc-4e1f-855a-59ba4af687b5 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-8a6db856-1218-4758-a471-3c764360d507 req-4298f969-5bcc-4e1f-855a-59ba4af687b5 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk 1073741824" returned: 0 in 0.052s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.236s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:13 user nova-compute[74075]: WARNING nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-709d9d2f-c9de-4e69-b9c6-d201733cc02d for instance with vm_state active and task_state deleting.
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-3f64d03b-372c-4542-b961-677277da707c for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:13 user nova-compute[74075]: WARNING nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-3f64d03b-372c-4542-b961-677277da707c for instance with vm_state active and task_state deleting.
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:13 user nova-compute[74075]: WARNING nova.compute.manager [req-13ae87bd-801a-4d22-8c1a-e385596655ed req-327cbb5d-2e40-40cd-a8ea-19b0534fb242 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state building and task_state spawning.
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.network.neutron [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Successfully created port: d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Cannot resize image /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Ensure instance console log exists: /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Instance destroyed successfully.
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.objects.instance [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lazy-loading 'resources' on Instance uuid c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap709d9d2f-c9, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ef0f292-7c3b-466e-ad37-453b6653b25c) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:23:b5,bridge_name='br-int',has_traffic_filtering=True,id=709d9d2f-c9de-4e69-b9c6-d201733cc02d,network=Network(ffacf509-ecbc-4734-bcac-70f2109ad8b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709d9d2f-c9')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f64d03b-37, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Successfully updated port: d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquired lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-changed-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Refreshing instance network info cache due to event network-changed-d9f2dfc4-35d0-434e-a604-927b009a1d07. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] Acquiring lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82db6428-cff4-41b1-8370-5477e0e4f790) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:33:77,bridge_name='br-int',has_traffic_filtering=True,id=3f64d03b-372c-4542-b961-677277da707c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f64d03b-37')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28abc9fa-72, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c823b8-10a7-41cc-96e0-bd0dd11c4890) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f3:4a,bridge_name='br-int',has_traffic_filtering=True,id=28abc9fa-723e-4cf8-9bcb-3bd8176a2652,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28abc9fa-72')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9e70323-20, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4e0174f-c347-4662-8749-8111e4ec308b) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=a9e70323-2071-44ca-94d4-4bbffea7a52c,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e70323-20')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc20fd7fa-c7, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dabf1b77-1770-4e73-a557-71a0964849fd) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:c8,bridge_name='br-int',has_traffic_filtering=True,id=c20fd7fa-c78a-49cb-aa40-c5ac23dd947e,network=Network(1f3c56fc-ee35-4b7f-9035-c962c6a54d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20fd7fa-c7')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "c602d44f-e69e-45fc-819d-f42d44d4de72", "address": "fa:16:3e:e4:5d:5e", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc602d44f-e6", "ovs_interfaceid": "c602d44f-e69e-45fc-819d-f42d44d4de72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Updating instance_info_cache with network_info: [{"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc602d44f-e6, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Releasing lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Instance network_info: |[{"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] Acquired lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.neutron [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Refreshing network info cache for port d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Start _get_guest_xml network_info=[{"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f975f01-e979-4122-b537-8a1a912c5109) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:14 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:5e,bridge_name='br-int',has_traffic_filtering=True,id=c602d44f-e69e-45fc-819d-f42d44d4de72,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc602d44f-e6')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1234318581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1234318581',id=14,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn9QIYwCtjZ17NP2ZKqYvRzm7741M47V2Mkr0WtGZ7jHlhD51fv55tiki1WalIjZ4cZxJK/0bKLRvdL1I8DR38dVm0YMxWrWd9lcmYBX0kFSuuMdweEQDJ86DLV0iBuug==',key_name='tempest-keypair-1137858549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce8f02598ef4a1e9e6a82aaabf3c2d4',ramdisk_id='',reservation_id='r-2m2dvp9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-720471860',owner_user_name='tempest-TaggedBootDevicesTest-720471860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd20a1bbfb05446ea7d8784eddf7ae87',uuid=c8d17aaf-95c6-49bd-9fdc-92c11cf5a764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converting VIF {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecda9578-a8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:14 user nova-compute[74075]: WARNING nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-28abc9fa-723e-4cf8-9bcb-3bd8176a2652 for instance with vm_state active and task_state deleting.
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:14 user nova-compute[74075]: WARNING nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e for instance with vm_state active and task_state deleting.
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:14 user nova-compute[74075]: WARNING nova.compute.manager [req-977b488b-527d-4f01-b0cf-b99c61e30f42 req-79e0b439-2b42-4044-b1b5-a223f8076583 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-ecda9578-a8c4-44e5-8fd8-dde526552ba0 for instance with vm_state active and task_state deleting.
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83d4edc5-1c99-477f-bbb9-cad943ed14fd) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-64765265',display_name='tempest-AttachVolumeNegativeTest-server-64765265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-64765265',id=23,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ87IRmtwQ31ZpVs0miiqE0oSZHXSOCBh4JdlgO+4aY6VN9tDh46TgIWm69LGR+IRusoRA9tVtAcuxoi91UMv3Anmtmj8A6GZIsZJ8AHaxP4w3hHUuTEukZSwNuvc/g9A==',key_name='tempest-keypair-555115776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-fx50zliz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=ac9fb9dc-3c56-4ec9-aec4-86a178160950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.objects.instance [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'pci_devices' on Instance uuid ac9fb9dc-3c56-4ec9-aec4-86a178160950 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:35:14 user nova-compute[74075]:   <uuid>ac9fb9dc-3c56-4ec9-aec4-86a178160950</uuid>
Oct 26 09:35:14 user nova-compute[74075]:   <name>instance-00000017</name>
Oct 26 09:35:14 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:35:14 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:35:14 user nova-compute[74075]:   <metadata>
Oct 26 09:35:14 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:35:14 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:35:14 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeNegativeTest-server-64765265</nova:name>
Oct 26 09:35:14 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:35:14</nova:creationTime>
Oct 26 09:35:14 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:35:14 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:35:14 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:35:14 user nova-compute[74075]:       <nova:owner>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:user uuid="c7604ae732734f05aaa7aeebf8ef5e1a">tempest-AttachVolumeNegativeTest-294403091-project-member</nova:user>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:project uuid="2e07b30415774466817048f8090437ee">tempest-AttachVolumeNegativeTest-294403091</nova:project>
Oct 26 09:35:14 user nova-compute[74075]:       </nova:owner>
Oct 26 09:35:14 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:35:14 user nova-compute[74075]:       <nova:ports>
Oct 26 09:35:14 user nova-compute[74075]:         <nova:port uuid="d9f2dfc4-35d0-434e-a604-927b009a1d07">
Oct 26 09:35:14 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 09:35:14 user nova-compute[74075]:         </nova:port>
Oct 26 09:35:14 user nova-compute[74075]:       </nova:ports>
Oct 26 09:35:14 user nova-compute[74075]:     </nova:instance>
Oct 26 09:35:14 user nova-compute[74075]:   </metadata>
Oct 26 09:35:14 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:35:14 user nova-compute[74075]:     <system>
Oct 26 09:35:14 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:35:14 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:35:14 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:35:14 user nova-compute[74075]:       <entry name="serial">ac9fb9dc-3c56-4ec9-aec4-86a178160950</entry>
Oct 26 09:35:14 user nova-compute[74075]:       <entry name="uuid">ac9fb9dc-3c56-4ec9-aec4-86a178160950</entry>
Oct 26 09:35:14 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:35:14 user nova-compute[74075]:     </system>
Oct 26 09:35:14 user nova-compute[74075]:   </sysinfo>
Oct 26 09:35:14 user nova-compute[74075]:   <os>
Oct 26 09:35:14 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:35:14 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:35:14 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:35:14 user nova-compute[74075]:   </os>
Oct 26 09:35:14 user nova-compute[74075]:   <features>
Oct 26 09:35:14 user nova-compute[74075]:     <acpi/>
Oct 26 09:35:14 user nova-compute[74075]:     <apic/>
Oct 26 09:35:14 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:35:14 user nova-compute[74075]:   </features>
Oct 26 09:35:14 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:35:14 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:35:14 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:35:14 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:35:14 user nova-compute[74075]:   </clock>
Oct 26 09:35:14 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:35:14 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:35:14 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:35:14 user nova-compute[74075]:   </cpu>
Oct 26 09:35:14 user nova-compute[74075]:   <devices>
Oct 26 09:35:14 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:14 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:14 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk"/>
Oct 26 09:35:14 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:35:14 user nova-compute[74075]:     </disk>
Oct 26 09:35:14 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:35:14 user nova-compute[74075]:       <mac address="fa:16:3e:09:9d:c6"/>
Oct 26 09:35:14 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:14 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:35:14 user nova-compute[74075]:       <target dev="tapd9f2dfc4-35"/>
Oct 26 09:35:14 user nova-compute[74075]:     </interface>
Oct 26 09:35:14 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:35:14 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/console.log" append="off"/>
Oct 26 09:35:14 user nova-compute[74075]:     </serial>
Oct 26 09:35:14 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:35:14 user nova-compute[74075]:     <video>
Oct 26 09:35:14 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:14 user nova-compute[74075]:     </video>
Oct 26 09:35:14 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:35:14 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:35:14 user nova-compute[74075]:     </rng>
Oct 26 09:35:14 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:35:14 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:35:14 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:35:14 user nova-compute[74075]:     </memballoon>
Oct 26 09:35:14 user nova-compute[74075]:   </devices>
Oct 26 09:35:14 user nova-compute[74075]: </domain>
Oct 26 09:35:14 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-64765265',display_name='tempest-AttachVolumeNegativeTest-server-64765265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-64765265',id=23,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ87IRmtwQ31ZpVs0miiqE0oSZHXSOCBh4JdlgO+4aY6VN9tDh46TgIWm69LGR+IRusoRA9tVtAcuxoi91UMv3Anmtmj8A6GZIsZJ8AHaxP4w3hHUuTEukZSwNuvc/g9A==',key_name='tempest-keypair-555115776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-fx50zliz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=ac9fb9dc-3c56-4ec9-aec4-86a178160950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_vif [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:07:79,bridge_name='br-int',has_traffic_filtering=True,id=ecda9578-a8c4-44e5-8fd8-dde526552ba0,network=Network(88a97c0c-f5b9-4108-aa8f-92cce28214ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda9578-a8')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06fe5de6-3e2c-54da-b938-32a82a02d9a2', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYNiOJUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:14 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9f2dfc4-35, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9f2dfc4-35, col_values=(('qos', UUID('bc42f70c-65f1-4b73-a1f3-cb81d2859ba9')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9f2dfc4-35, col_values=(('external_ids', {'iface-id': 'd9f2dfc4-35d0-434e-a604-927b009a1d07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:9d:c6', 'vm-uuid': 'ac9fb9dc-3c56-4ec9-aec4-86a178160950'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:14 user nova-compute[74075]: INFO os_vif [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35')
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3faa3e-135c-46b0-9e56-d1bd67982e9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:35:14 user nova-compute[74075]: No targets found.
Oct 26 09:35:14 user nova-compute[74075]: iSNS:
Oct 26 09:35:14 user nova-compute[74075]: No targets found.
Oct 26 09:35:14 user nova-compute[74075]: STATIC:
Oct 26 09:35:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:35:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663
Oct 26 09:35:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:35:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275
Oct 26 09:35:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31
Oct 26 09:35:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:35:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:14 user nova-compute[74075]: FIRMWARE:
Oct 26 09:35:14 user nova-compute[74075]: No targets found.
Oct 26 09:35:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:35:14 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:35:14 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b978d4-ccc1-45c7-867a-96a9597bb149]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5c977-9708-46df-be0e-555f2499f2ab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:14 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:35:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:09:9d:c6, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[81184385-2fc0-410f-82e8-1faecd2dc85c]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aa5b78-d7b8-46a3-86b2-94b22554cd07]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac2973-b82a-40cb-b54b-a01711951fbc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[855791fe-4221-4573-b16a-5640b34762a2]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b7f882-784a-4a35-b77e-ae5ca90f83d3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Updated VIF entry in instance network info cache for port d9f2dfc4-35d0-434e-a604-927b009a1d07. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Updating instance_info_cache with network_info: [{"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd878118-01a8-4b3d-bfbe-317586b9d715 req-79387a74-b3d2-4f6b-bb5f-f4ca837a15b7 service nova] Releasing lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --logout" returned: 0 in 0.155s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f3979-3870-4eb1-b7f4-abeda2dae57a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260]
Oct 26 09:35:15 user nova-compute[74075]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6922b977-39aa-40c8-96e3-f722ccf6f275 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f9a9a-1158-49ab-ae08-928fee791c5f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== disconnect_volume: return (453ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdfZUKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3370c4-7ef6-4043-853f-e726d1399d53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:35:15 user nova-compute[74075]: No targets found.
Oct 26 09:35:15 user nova-compute[74075]: iSNS:
Oct 26 09:35:15 user nova-compute[74075]: No targets found.
Oct 26 09:35:15 user nova-compute[74075]: STATIC:
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: FIRMWARE:
Oct 26 09:35:15 user nova-compute[74075]: No targets found.
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:35:15 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:35:15 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527388d-8efd-4403-bd86-cf1340476fb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state building and task_state spawning.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-a9e70323-2071-44ca-94d4-4bbffea7a52c for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-a9e70323-2071-44ca-94d4-4bbffea7a52c for instance with vm_state active and task_state deleting.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-unplugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-unplugged-c602d44f-e69e-45fc-819d-f42d44d4de72 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] No waiting events found dispatching network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received unexpected event network-vif-plugged-c602d44f-e69e-45fc-819d-f42d44d4de72 for instance with vm_state active and task_state deleting.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING nova.compute.manager [req-4ec27bef-0ba0-48d2-9314-eba4cf81be7c req-131e63c1-18b4-4924-b351-22372ba6f124 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6d50fb-a1d8-42b6-8aa5-565209be79b2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2783a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f2492d-fae9-49e3-a72d-e8ba23da639d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d17c6a-666e-4dcd-886e-c41bdc52cc3e]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf78246-ac72-4f58-934a-c69c5ea407fc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c5d5f4-18a9-4a7d-8187-f7bc5ba12d19]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b453c4-60a2-47be-879b-8c413e0c9722]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:35:15 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance spawned successfully.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cb0147-9757-40ff-ab29-60d90cfc34f1]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260]
Oct 26 09:35:15 user nova-compute[74075]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d429dd-394a-43d1-94ad-48a5feff4663 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[756243a5-85df-4adc-8163-105b0c65b18b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== disconnect_volume: return (370ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnITpuAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:15 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c671996-04b6-4555-b76b-e531110c6eb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:35:15 user nova-compute[74075]: No targets found.
Oct 26 09:35:15 user nova-compute[74075]: iSNS:
Oct 26 09:35:15 user nova-compute[74075]: No targets found.
Oct 26 09:35:15 user nova-compute[74075]: STATIC:
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:35:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:15 user nova-compute[74075]: FIRMWARE:
Oct 26 09:35:15 user nova-compute[74075]: No targets found.
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:35:15 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:35:15 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3874b93c-3ff1-4644-b0e2-8e04c2316727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: INFO nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Took 8.53 seconds to spawn the instance on the hypervisor.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-28a106bc-1949-4488-ba5a-b8fb015165ca tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f04ba6-9825-4314-90f5-32d209d96e76]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:15 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f465c3d30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31'): ({'sde'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Removing single pathed devices sde {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d79fed-d5a1-4ab8-b92d-6aa6384d4161]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde343d-7437-4140-a872-344f1f049e08]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Flushing IO for device /dev/sde {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f188fd98-4e74-4844-b319-82841cd0916c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: INFO nova.compute.manager [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Took 9.44 seconds to build instance.
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3c2c60b-f6fe-414c-aa8c-deb0ba4f55ac tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.560s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac52488c-ea4e-4c0d-9ae0-9ffd801c05bb]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b73bae-972b-4de7-8c38-6c99aa0b464f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7a8800-9137-4d03-b2f0-a3b0f1ab41ac]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260]
Oct 26 09:35:16 user nova-compute[74075]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:16 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf248cdd-cffc-4721-8cfe-a5c3bcfe1a31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a4f30-fc44-454b-b1fa-ad6c26ff1e1a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] <== disconnect_volume: return (356ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:35:16 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Deleting instance files /opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764_del
Oct 26 09:35:16 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Deletion of /opt/stack/data/nova/instances/c8d17aaf-95c6-49bd-9fdc-92c11cf5a764_del complete
Oct 26 09:35:16 user nova-compute[74075]: INFO nova.compute.manager [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Took 4.34 seconds to destroy the instance on the hypervisor.
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-af21ec5d-bf5c-4a10-9241-9de668c6b024 req-597726a2-9b54-461d-81de-0573ac55019a service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-af21ec5d-bf5c-4a10-9241-9de668c6b024 req-597726a2-9b54-461d-81de-0573ac55019a service nova] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-af21ec5d-bf5c-4a10-9241-9de668c6b024 req-597726a2-9b54-461d-81de-0573ac55019a service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-af21ec5d-bf5c-4a10-9241-9de668c6b024 req-597726a2-9b54-461d-81de-0573ac55019a service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-af21ec5d-bf5c-4a10-9241-9de668c6b024 req-597726a2-9b54-461d-81de-0573ac55019a service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] No waiting events found dispatching network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:16 user nova-compute[74075]: WARNING nova.compute.manager [req-af21ec5d-bf5c-4a10-9241-9de668c6b024 req-597726a2-9b54-461d-81de-0573ac55019a service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received unexpected event network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 for instance with vm_state building and task_state spawning.
Oct 26 09:35:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAkPgXju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:18 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:18 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:18 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35388f-8eac-4be2-ad5c-ecf00b217463]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:35:18 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac978735-df53-47e0-9ba9-4bdc9170354a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9] added
Oct 26 09:35:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a595e5-def9-4666-9286-eaa5d1ef1b93]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e45635-0b41-4d68-9dfe-142761852d35]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAkPgXju {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAkPgXju" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[05baa510-efe2-49ff-b4cd-5c8e9608a1d5]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAkPgXju'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f745c38-4652-4cbc-9a4c-dfee5c56865e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ad070e-1fb5-4a5e-aa37-4794c61eeec0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[327fad64-6bf5-41ab-965c-59b42fbc0d03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260]
Oct 26 09:35:18 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:35:18 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Instance spawned successfully.
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9e94e3-4d64-4adc-b506-4492ace25c47]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0844035c-6edc-4364-aaa0-ac185e092f9e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:18 user nova-compute[74075]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 (non-flash)
Oct 26 09:35:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[498dbd2f-4c6f-4266-b5a7-0c0f26ce043a]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:18 user nova-compute[74075]: INFO nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] No waiting events found dispatching network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:18 user nova-compute[74075]: WARNING nova.compute.manager [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received unexpected event network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 for instance with vm_state building and task_state spawning.
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-deleted-c602d44f-e69e-45fc-819d-f42d44d4de72 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:18 user nova-compute[74075]: INFO nova.compute.manager [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Neutron deleted interface c602d44f-e69e-45fc-819d-f42d44d4de72; detaching it from the instance and deleting it from the info cache
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.network.neutron [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [{"id": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "address": "fa:16:3e:bc:23:b5", "network": {"id": "ffacf509-ecbc-4734-bcac-70f2109ad8b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1691396203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap709d9d2f-c9", "ovs_interfaceid": "709d9d2f-c9de-4e69-b9c6-d201733cc02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f64d03b-372c-4542-b961-677277da707c", "address": "fa:16:3e:b7:33:77", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64d03b-37", "ovs_interfaceid": "3f64d03b-372c-4542-b961-677277da707c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "address": "fa:16:3e:f6:f3:4a", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28abc9fa-72", "ovs_interfaceid": "28abc9fa-723e-4cf8-9bcb-3bd8176a2652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "address": "fa:16:3e:40:72:a6", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e70323-20", "ovs_interfaceid": "a9e70323-2071-44ca-94d4-4bbffea7a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "address": "fa:16:3e:c1:57:c8", "network": {"id": "1f3c56fc-ee35-4b7f-9035-c962c6a54d32", "bridge": "br-int", "label": "tempest-device-tagging-net1-1320844370", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20fd7fa-c7", "ovs_interfaceid": "c20fd7fa-c78a-49cb-aa40-c5ac23dd947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "address": "fa:16:3e:d3:07:79", "network": {"id": "88a97c0c-f5b9-4108-aa8f-92cce28214ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013258541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ce8f02598ef4a1e9e6a82aaabf3c2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda9578-a8", "ovs_interfaceid": "ecda9578-a8c4-44e5-8fd8-dde526552ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-132b9c9c-0dae-4dc7-acc1-62ef940a8881 req-a95544de-b8ec-4ad0-828d-a4cd360eb036 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Detach interface failed, port_id=c602d44f-e69e-45fc-819d-f42d44d4de72, reason: Instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:35:18 user nova-compute[74075]: INFO nova.compute.manager [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Took 7.27 seconds to build instance.
Oct 26 09:35:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-50c3ee34-717d-41bb-9f6b-3f86e50fffc1 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.387s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAkPgXju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26463383230393634', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383230393634', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lazy-loading 'flavor' on Instance uuid b51b900c-8776-4654-8acd-4d406a5ed7b9 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:35:19 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:35:19 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:35:19 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:35:19 user nova-compute[74075]:   <serial>6cd3e58b-61ac-4fd2-8ac6-22cab37074c9</serial>
Oct 26 09:35:19 user nova-compute[74075]: </disk>
Oct 26 09:35:19 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:35:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] No VIF found with MAC fa:16:3e:35:6c:6b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:20 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Took 4.12 seconds to deallocate network for instance.
Oct 26 09:35:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c6051b67-3eb0-47e0-9cd9-dcbbd8e003e2 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.950s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:20 user nova-compute[74075]: INFO nova.compute.manager [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Terminating instance
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-b30f971c-866c-4596-9267-5d0dde2bbf14 req-3dd08b10-6d4a-4852-87e1-d47ee68fb3c6 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-deleted-c20fd7fa-c78a-49cb-aa40-c5ac23dd947e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-b30f971c-866c-4596-9267-5d0dde2bbf14 req-3dd08b10-6d4a-4852-87e1-d47ee68fb3c6 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-deleted-709d9d2f-c9de-4e69-b9c6-d201733cc02d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-b30f971c-866c-4596-9267-5d0dde2bbf14 req-3dd08b10-6d4a-4852-87e1-d47ee68fb3c6 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-deleted-ecda9578-a8c4-44e5-8fd8-dde526552ba0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-b30f971c-866c-4596-9267-5d0dde2bbf14 req-3dd08b10-6d4a-4852-87e1-d47ee68fb3c6 service nova] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Received event network-vif-deleted-a9e70323-2071-44ca-94d4-4bbffea7a52c {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Instance destroyed successfully.
Oct 26 09:35:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lazy-loading 'resources' on Instance uuid b51b900c-8776-4654-8acd-4d406a5ed7b9 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-364408767',display_name='tempest-DeleteServersTestJSON-server-364408767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-364408767',id=21,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3be82ea29d3e4ac391dcc1c46821188b',ramdisk_id='',reservation_id='r-st20xg43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-159528353',owner_user_name='tempest-DeleteServersTestJSON-159528353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:33:10Z,user_data=None,user_id='cb1c1ea1d50b40cfb52679eeea0133dd',uuid=b51b900c-8776-4654-8acd-4d406a5ed7b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Converting VIF {"id": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "address": "fa:16:3e:35:6c:6b", "network": {"id": "3fc7581c-3bbb-4e9d-90df-aec66f37b8b2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1134939712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be82ea29d3e4ac391dcc1c46821188b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57185cbe-fe", "ovs_interfaceid": "57185cbe-feb3-499e-9c6d-ddfa9e7f7d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_vif [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57185cbe-fe, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9d5bf11-bdaa-4e3b-9759-99084b8f2244) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: INFO os_vif [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:6b,bridge_name='br-int',has_traffic_filtering=True,id=57185cbe-feb3-499e-9c6d-ddfa9e7f7d02,network=Network(3fc7581c-3bbb-4e9d-90df-aec66f37b8b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57185cbe-fe')
Oct 26 09:35:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAkPgXju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:21 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f8f8f0-a2f4-4bdd-87eb-d5b6d6953f6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:35:21 user nova-compute[74075]: No targets found.
Oct 26 09:35:21 user nova-compute[74075]: iSNS:
Oct 26 09:35:21 user nova-compute[74075]: No targets found.
Oct 26 09:35:21 user nova-compute[74075]: STATIC:
Oct 26 09:35:21 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:35:21 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:21 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:21 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9
Oct 26 09:35:21 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:21 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:21 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:35:21 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:21 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:21 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:35:21 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:21 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:21 user nova-compute[74075]: FIRMWARE:
Oct 26 09:35:21 user nova-compute[74075]: No targets found.
Oct 26 09:35:21 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:35:21 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:35:21 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ebe27f-809f-470c-887d-6a817eb495da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3bb0be-acfb-4818-b154-9b3ba7f28e4d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:21 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:21 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:21 user nova-compute[74075]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 (non-flash)
Oct 26 09:35:21 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:21 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:21 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:21 user nova-compute[74075]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 (non-flash)
Oct 26 09:35:21 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f466418ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879c485-4be4-4900-9ccd-c85ac31bc71d]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca4bb3-ef0f-455f-9ede-8a529d616311]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd880c6-959e-4b33-bf83-2893183f502e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d0139-e0f7-4b41-b2aa-c1f6b29c3eb4]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f216c49-ee41-40a0-a7a3-63a6bbc4b9ec]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[baffba8c-fc9f-440c-b394-e40f52b71975]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260]
Oct 26 09:35:22 user nova-compute[74075]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3e58b-61ac-4fd2-8ac6-22cab37074c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3679dc3b-f6f2-44af-9631-d4df9292a656]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] <== disconnect_volume: return (384ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:35:22 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Deleting instance files /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9_del
Oct 26 09:35:22 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Deletion of /opt/stack/data/nova/instances/b51b900c-8776-4654-8acd-4d406a5ed7b9_del complete
Oct 26 09:35:22 user nova-compute[74075]: INFO nova.compute.manager [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:22 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Took 0.42 seconds to deallocate network for instance.
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-vif-unplugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] No waiting events found dispatching network-vif-unplugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-vif-unplugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] Acquiring lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] No waiting events found dispatching network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:22 user nova-compute[74075]: WARNING nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received unexpected event network-vif-plugged-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 for instance with vm_state active and task_state deleting.
Oct 26 09:35:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-7fafce76-2a66-4486-a63c-55ea7b7e04e8 req-fdb7b884-b2c9-4148-ad2d-303fda191f77 service nova] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Received event network-vif-deleted-57185cbe-feb3-499e-9c6d-ddfa9e7f7d02 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:23 user nova-compute[74075]: INFO nova.compute.manager [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] [instance: b51b900c-8776-4654-8acd-4d406a5ed7b9] Took 0.51 seconds to detach 1 volumes for instance.
Oct 26 09:35:23 user nova-compute[74075]: INFO nova.compute.manager [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] [instance: c8d17aaf-95c6-49bd-9fdc-92c11cf5a764] Took 2.82 seconds to detach 3 volumes for instance.
Oct 26 09:35:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:23 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:23 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.433s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:23 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Deleted allocations for instance b51b900c-8776-4654-8acd-4d406a5ed7b9
Oct 26 09:35:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3a3d24a5-d4fb-4962-b7fb-dc89beb8fca6 tempest-DeleteServersTestJSON-159528353 tempest-DeleteServersTestJSON-159528353-project-member] Lock "b51b900c-8776-4654-8acd-4d406a5ed7b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:24 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:24 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:24 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Deleted allocations for instance c8d17aaf-95c6-49bd-9fdc-92c11cf5a764
Oct 26 09:35:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-561e487a-3c83-4257-81c6-5e55b6fd65cb tempest-TaggedBootDevicesTest-720471860 tempest-TaggedBootDevicesTest-720471860-project-member] Lock "c8d17aaf-95c6-49bd-9fdc-92c11cf5a764" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.473s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:26 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:26 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:26 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c5afa4-4949-4d36-9da7-36ecda325ac6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:35:26 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcaf96e-4ddb-40bf-81dc-02cf90334783]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d] added
Oct 26 09:35:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c92608-6251-4aeb-846d-2e8f6e54aa1c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c031e-e40c-42b4-96c6-e1ce3dd886cf]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woOWEkuy {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woOWEkuy" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb327ba3-dcb7-4feb-aa61-9eb7be0583bc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woOWEkuy'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b6d0e-eaaa-4254-95cb-005e77ff9159]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa91c17-a110-47a6-9be4-8b3ada89029e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b77c08-7e63-473c-92ca-a025930bb53c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]
Oct 26 09:35:26 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30576a8-b354-4e98-83a1-d4ec8a10c54d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1041fa62-c80d-4d4e-b5d5-21e04328685a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:35:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:26 user nova-compute[74075]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:35:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[303514ba-ba49-451c-a7f5-ee1418749503]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:35:27 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:27 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23662323839383564', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662323839383564', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:35:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'flavor' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:35:27 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:35:27 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:35:27 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:35:27 user nova-compute[74075]:   <serial>5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d</serial>
Oct 26 09:35:27 user nova-compute[74075]: </disk>
Oct 26 09:35:27 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:35:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No VIF found with MAC fa:16:3e:7d:66:e0, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f312e84f-aafc-448f-b746-c63159658b80 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.855s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Stashing vm_state: active {{(pid=74075) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 09:35:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:30 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:35:30 user nova-compute[74075]: INFO nova.compute.claims [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Claim successful on node user
Oct 26 09:35:30 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating resource usage from migration 0d67b7d3-00b2-47ff-8162-b11934b27b76
Oct 26 09:35:31 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.550s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:31 user nova-compute[74075]: INFO nova.compute.manager [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Migrating
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:31 user nova-compute[74075]: INFO nova.compute.rpcapi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Starting migrate_disk_and_power_off {{(pid=74075) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-edfd4c14-2144-483d-b0dd-ee38582c3758 req-3588bcdf-7112-43b8-a83d-affccab32c73 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-edfd4c14-2144-483d-b0dd-ee38582c3758 req-3588bcdf-7112-43b8-a83d-affccab32c73 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-edfd4c14-2144-483d-b0dd-ee38582c3758 req-3588bcdf-7112-43b8-a83d-affccab32c73 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-edfd4c14-2144-483d-b0dd-ee38582c3758 req-3588bcdf-7112-43b8-a83d-affccab32c73 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-edfd4c14-2144-483d-b0dd-ee38582c3758 req-3588bcdf-7112-43b8-a83d-affccab32c73 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:32 user nova-compute[74075]: WARNING nova.compute.manager [req-edfd4c14-2144-483d-b0dd-ee38582c3758 req-3588bcdf-7112-43b8-a83d-affccab32c73 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state resize_migrating.
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:32 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:35:32 user nova-compute[74075]: INFO nova.compute.claims [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Claim successful on node user
Oct 26 09:35:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance destroyed successfully.
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f2ea36f-be, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58bd9d1f-afe3-4e11-8f02-0927743f2720) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:33 user nova-compute[74075]: INFO os_vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be')
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:33 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1e3775-85b3-42f4-9a57-8cf1f8865134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:35:33 user nova-compute[74075]: No targets found.
Oct 26 09:35:33 user nova-compute[74075]: iSNS:
Oct 26 09:35:33 user nova-compute[74075]: No targets found.
Oct 26 09:35:33 user nova-compute[74075]: STATIC:
Oct 26 09:35:33 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:35:33 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:33 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:33 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:35:33 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:33 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:33 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:35:33 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:33 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:33 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:35:33 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:35:33 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:35:33 user nova-compute[74075]: FIRMWARE:
Oct 26 09:35:33 user nova-compute[74075]: No targets found.
Oct 26 09:35:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:35:33 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:35:33 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3103f6-4f2f-4059-a5bb-0e8a5b440671]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa65666-3414-47d9-8172-67d6c3034ada]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:33 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:33 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:33 user nova-compute[74075]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:35:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:33 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:33 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:33 user nova-compute[74075]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:35:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46287431c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[db026efa-39cb-4b13-93d4-0c7eb05eeac3]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.090s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[258ae24a-fc34-486d-bab9-f71bd15a8bed]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef235d-fd5a-4c81-86ed-e392fc682011]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbaee69-d40d-49cf-8c4d-a9a1982c63ec]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a52e0-f085-415e-98db-d0a65946f41d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b841d4-704f-460b-8f26-e26a7ebf8cf3]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]
Oct 26 09:35:33 user nova-compute[74075]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b1325d-fcbb-4cd6-8d89-ee836a7677d3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== disconnect_volume: return (381ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:35:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.policy [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '454822c8719441388cd38cd86b736b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c09f49b38ff4e4f96fa233d1c8e33f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:35:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Creating image(s)
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "/opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "/opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "/opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5_resize/disk /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk 1073741824" returned: 0 in 0.053s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "cp -r /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5_resize/disk /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk" returned: 0 in 0.460s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5_resize/disk.info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk.info {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "cp -r /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5_resize/disk.info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk.info" returned: 0 in 0.031s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Successfully created port: 0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-bd8f0165-e3aa-421c-9dfc-01180e30a17d req-576279da-5b13-4603-aa7f-8174ac0bfae0 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd8f0165-e3aa-421c-9dfc-01180e30a17d req-576279da-5b13-4603-aa7f-8174ac0bfae0 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd8f0165-e3aa-421c-9dfc-01180e30a17d req-576279da-5b13-4603-aa7f-8174ac0bfae0 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd8f0165-e3aa-421c-9dfc-01180e30a17d req-576279da-5b13-4603-aa7f-8174ac0bfae0 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-bd8f0165-e3aa-421c-9dfc-01180e30a17d req-576279da-5b13-4603-aa7f-8174ac0bfae0 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:34 user nova-compute[74075]: WARNING nova.compute.manager [req-bd8f0165-e3aa-421c-9dfc-01180e30a17d req-576279da-5b13-4603-aa7f-8174ac0bfae0 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state resize_migrating.
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Cannot resize image /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Ensure instance console log exists: /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Successfully updated port: 0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquired lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-changed-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Refreshing instance network info cache due to event network-changed-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] Acquiring lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updating instance_info_cache with network_info: [{"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Releasing lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Instance network_info: |[{"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] Acquired lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Refreshing network info cache for port 0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Start _get_guest_xml network_info=[{"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:35:35 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:35 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2033539692',display_name='tempest-AttachVolumeTestJSON-server-2033539692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2033539692',id=24,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7VqE5t8JiVih8sJq1tYFKnN/My3nIEwOyxMYcCgHUsJZDQGmoRj+vqQbkV4dRjJ+uvCzmMKrWgqc4YTpS6wUun+ALwJEtfpWWJIpgTlt1Bi1qhVEhR4h+0ou0g01quhw==',key_name='tempest-keypair-949214122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-02quyn1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=26902518-83b8-4811-a1bb-fc70a8786fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.objects.instance [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'pci_devices' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:35:35 user nova-compute[74075]:   <uuid>26902518-83b8-4811-a1bb-fc70a8786fbd</uuid>
Oct 26 09:35:35 user nova-compute[74075]:   <name>instance-00000018</name>
Oct 26 09:35:35 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:35:35 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:35:35 user nova-compute[74075]:   <metadata>
Oct 26 09:35:35 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:35:35 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:35:35 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeTestJSON-server-2033539692</nova:name>
Oct 26 09:35:35 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:35:35</nova:creationTime>
Oct 26 09:35:35 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:35:35 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:35:35 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:35:35 user nova-compute[74075]:       <nova:owner>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:user uuid="454822c8719441388cd38cd86b736b3c">tempest-AttachVolumeTestJSON-1598575575-project-member</nova:user>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:project uuid="4c09f49b38ff4e4f96fa233d1c8e33f4">tempest-AttachVolumeTestJSON-1598575575</nova:project>
Oct 26 09:35:35 user nova-compute[74075]:       </nova:owner>
Oct 26 09:35:35 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:35:35 user nova-compute[74075]:       <nova:ports>
Oct 26 09:35:35 user nova-compute[74075]:         <nova:port uuid="0287d2e8-161d-4c34-94c7-22e3cbe0ebc4">
Oct 26 09:35:35 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:35:35 user nova-compute[74075]:         </nova:port>
Oct 26 09:35:35 user nova-compute[74075]:       </nova:ports>
Oct 26 09:35:35 user nova-compute[74075]:     </nova:instance>
Oct 26 09:35:35 user nova-compute[74075]:   </metadata>
Oct 26 09:35:35 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:35:35 user nova-compute[74075]:     <system>
Oct 26 09:35:35 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:35:35 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:35:35 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:35:35 user nova-compute[74075]:       <entry name="serial">26902518-83b8-4811-a1bb-fc70a8786fbd</entry>
Oct 26 09:35:35 user nova-compute[74075]:       <entry name="uuid">26902518-83b8-4811-a1bb-fc70a8786fbd</entry>
Oct 26 09:35:35 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:35:35 user nova-compute[74075]:     </system>
Oct 26 09:35:35 user nova-compute[74075]:   </sysinfo>
Oct 26 09:35:35 user nova-compute[74075]:   <os>
Oct 26 09:35:35 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:35:35 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:35:35 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:35:35 user nova-compute[74075]:   </os>
Oct 26 09:35:35 user nova-compute[74075]:   <features>
Oct 26 09:35:35 user nova-compute[74075]:     <acpi/>
Oct 26 09:35:35 user nova-compute[74075]:     <apic/>
Oct 26 09:35:35 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:35:35 user nova-compute[74075]:   </features>
Oct 26 09:35:35 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:35:35 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:35:35 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:35:35 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:35:35 user nova-compute[74075]:   </clock>
Oct 26 09:35:35 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:35:35 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:35:35 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:35:35 user nova-compute[74075]:   </cpu>
Oct 26 09:35:35 user nova-compute[74075]:   <devices>
Oct 26 09:35:35 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:35 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:35 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk"/>
Oct 26 09:35:35 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:35:35 user nova-compute[74075]:     </disk>
Oct 26 09:35:35 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:35:35 user nova-compute[74075]:       <mac address="fa:16:3e:28:06:26"/>
Oct 26 09:35:35 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:35 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:35:35 user nova-compute[74075]:       <target dev="tap0287d2e8-16"/>
Oct 26 09:35:35 user nova-compute[74075]:     </interface>
Oct 26 09:35:35 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:35:35 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/console.log" append="off"/>
Oct 26 09:35:35 user nova-compute[74075]:     </serial>
Oct 26 09:35:35 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:35:35 user nova-compute[74075]:     <video>
Oct 26 09:35:35 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:35 user nova-compute[74075]:     </video>
Oct 26 09:35:35 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:35:35 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:35:35 user nova-compute[74075]:     </rng>
Oct 26 09:35:35 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:35:35 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:35:35 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:35:35 user nova-compute[74075]:     </memballoon>
Oct 26 09:35:35 user nova-compute[74075]:   </devices>
Oct 26 09:35:35 user nova-compute[74075]: </domain>
Oct 26 09:35:35 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2033539692',display_name='tempest-AttachVolumeTestJSON-server-2033539692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2033539692',id=24,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7VqE5t8JiVih8sJq1tYFKnN/My3nIEwOyxMYcCgHUsJZDQGmoRj+vqQbkV4dRjJ+uvCzmMKrWgqc4YTpS6wUun+ALwJEtfpWWJIpgTlt1Bi1qhVEhR4h+0ou0g01quhw==',key_name='tempest-keypair-949214122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-02quyn1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=26902518-83b8-4811-a1bb-fc70a8786fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG os_vif [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b61ef671-86b4-53b5-8025-d4712867bc3c', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0287d2e8-16, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0287d2e8-16, col_values=(('qos', UUID('26918661-e4fd-42ac-8bc4-f83cef587a21')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0287d2e8-16, col_values=(('external_ids', {'iface-id': '0287d2e8-161d-4c34-94c7-22e3cbe0ebc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:06:26', 'vm-uuid': '26902518-83b8-4811-a1bb-fc70a8786fbd'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:35 user nova-compute[74075]: INFO os_vif [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16')
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Port 0f2ea36f-be05-482a-bd66-736c4d8b36f0 binding to destination host user is already ACTIVE {{(pid=74075) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No VIF found with MAC fa:16:3e:28:06:26, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updated VIF entry in instance network info cache for port 0287d2e8-161d-4c34-94c7-22e3cbe0ebc4. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:35:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updating instance_info_cache with network_info: [{"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d000795d-9e6e-43e5-aa12-65b0f3cff767 req-ca9ca300-e311-4d5a-9a99-005f117f6b0f service nova] Releasing lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG os_brick.utils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf139cd-7754-47cb-90da-01937e310403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e7bc61-c7f1-4597-889b-fed8eaa280a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada26725-3702-4d52-a11c-bb5d6dfbf089]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffddaf8b-27b3-47f0-bfc9-db0e1755afb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:35:36 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4796a92-9398-4522-a890-2cb30fad2bc9]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG os_brick.utils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-018ea3dd-4f49-4220-926e-c620dd63effa req-2193193c-a416-46e3-a93e-7ef85486217c service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-018ea3dd-4f49-4220-926e-c620dd63effa req-2193193c-a416-46e3-a93e-7ef85486217c service nova] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-018ea3dd-4f49-4220-926e-c620dd63effa req-2193193c-a416-46e3-a93e-7ef85486217c service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-018ea3dd-4f49-4220-926e-c620dd63effa req-2193193c-a416-46e3-a93e-7ef85486217c service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-018ea3dd-4f49-4220-926e-c620dd63effa req-2193193c-a416-46e3-a93e-7ef85486217c service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] No waiting events found dispatching network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:37 user nova-compute[74075]: WARNING nova.compute.manager [req-018ea3dd-4f49-4220-926e-c620dd63effa req-2193193c-a416-46e3-a93e-7ef85486217c service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received unexpected event network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 for instance with vm_state building and task_state spawning.
Oct 26 09:35:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:35:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:35:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Instance spawned successfully.
Oct 26 09:35:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:35:39 user nova-compute[74075]: INFO nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:35:39 user nova-compute[74075]: INFO nova.compute.manager [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Took 6.27 seconds to build instance.
Oct 26 09:35:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aecd14f4-75d6-4fb4-a671-146670233105 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.376s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-c7864003-446a-433d-a7e4-2a5a6ca92644 req-989103bd-0aaf-4053-9891-c8b45ff964f0 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c7864003-446a-433d-a7e4-2a5a6ca92644 req-989103bd-0aaf-4053-9891-c8b45ff964f0 service nova] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c7864003-446a-433d-a7e4-2a5a6ca92644 req-989103bd-0aaf-4053-9891-c8b45ff964f0 service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c7864003-446a-433d-a7e4-2a5a6ca92644 req-989103bd-0aaf-4053-9891-c8b45ff964f0 service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-c7864003-446a-433d-a7e4-2a5a6ca92644 req-989103bd-0aaf-4053-9891-c8b45ff964f0 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] No waiting events found dispatching network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:39 user nova-compute[74075]: WARNING nova.compute.manager [req-c7864003-446a-433d-a7e4-2a5a6ca92644 req-989103bd-0aaf-4053-9891-c8b45ff964f0 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received unexpected event network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 for instance with vm_state building and task_state spawning.
Oct 26 09:35:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:40 user nova-compute[74075]: INFO nova.compute.manager [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Rescuing
Oct 26 09:35:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:35:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:35:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-9e3d9787-81e0-491b-a9da-9ce73c7389a3 req-6e14e4df-a212-414d-99e5-d4199d0d5738 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9e3d9787-81e0-491b-a9da-9ce73c7389a3 req-6e14e4df-a212-414d-99e5-d4199d0d5738 service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9e3d9787-81e0-491b-a9da-9ce73c7389a3 req-6e14e4df-a212-414d-99e5-d4199d0d5738 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9e3d9787-81e0-491b-a9da-9ce73c7389a3 req-6e14e4df-a212-414d-99e5-d4199d0d5738 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-9e3d9787-81e0-491b-a9da-9ce73c7389a3 req-6e14e4df-a212-414d-99e5-d4199d0d5738 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:41 user nova-compute[74075]: WARNING nova.compute.manager [req-9e3d9787-81e0-491b-a9da-9ce73c7389a3 req-6e14e4df-a212-414d-99e5-d4199d0d5738 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance destroyed successfully.
Oct 26 09:35:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Attempting a stable device rescue
Oct 26 09:35:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74075) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 09:35:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:35:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Creating image(s)
Oct 26 09:35:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG nova.virt.images [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] 3b589e79-a976-4977-8899-17c5203aee98 was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.part /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-1fe8470a-29da-46cc-9882-9f682dc0ffd6 req-365e066f-c54d-43aa-bafc-2c75c6a4ed0c service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1fe8470a-29da-46cc-9882-9f682dc0ffd6 req-365e066f-c54d-43aa-bafc-2c75c6a4ed0c service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1fe8470a-29da-46cc-9882-9f682dc0ffd6 req-365e066f-c54d-43aa-bafc-2c75c6a4ed0c service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1fe8470a-29da-46cc-9882-9f682dc0ffd6 req-365e066f-c54d-43aa-bafc-2c75c6a4ed0c service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-1fe8470a-29da-46cc-9882-9f682dc0ffd6 req-365e066f-c54d-43aa-bafc-2c75c6a4ed0c service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:43 user nova-compute[74075]: WARNING nova.compute.manager [req-1fe8470a-29da-46cc-9882-9f682dc0ffd6 req-365e066f-c54d-43aa-bafc-2c75c6a4ed0c service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.part /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.converted" returned: 0 in 0.423s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.880s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5 --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5,backing_fmt=raw /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5,backing_fmt=raw /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue" returned: 0 in 0.045s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'migration_context' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<8b522482-66ab-4ae4-b851-9e4b74433fe6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Start _get_guest_xml network_info=[{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "vif_mac": "fa:16:3e:ff:da:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3b589e79-a976-4977-8899-17c5203aee98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '2f917335-e2c9-443b-bbcb-70c34a091be8', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8b522482-66ab-4ae4-b851-9e4b74433fe6', 'attached_at': '', 'detached_at': '', 'volume_id': '4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'serial': '4a945ccc-dbb8-4338-84ee-d7d247be53f2'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'resources' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<8b522482-66ab-4ae4-b851-9e4b74433fe6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<8b522482-66ab-4ae4-b851-9e4b74433fe6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<8b522482-66ab-4ae4-b851-9e4b74433fe6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:44 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3578a81d-7277-4d1e-beea-3155aa8bb3a3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cALwitfb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 09:35:44 user nova-compute[74075]: node.name = iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:35:44 user nova-compute[74075]: node.tpgt = -1
Oct 26 09:35:44 user nova-compute[74075]: node.startup = automatic
Oct 26 09:35:44 user nova-compute[74075]: node.leading_login = No
Oct 26 09:35:44 user nova-compute[74075]: iface.iscsi_ifacename = default
Oct 26 09:35:44 user nova-compute[74075]: iface.net_ifacename = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.ipaddress = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.prefix_len = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.hwaddress = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.transport_name = tcp
Oct 26 09:35:44 user nova-compute[74075]: iface.initiatorname = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.vlan_id = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.vlan_priority = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.vlan_state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.iface_num = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.mtu = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.port = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.bootproto = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.subnet_mask = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.gateway = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_alt_client_id = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_dns = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_learn_iqn = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_vendor_id_state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_vendor_id = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.dhcp_slp_da = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.fragmentation = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.gratuitous_arp = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.incoming_forwarding = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.tos_state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.tos = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.ttl = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.delayed_ack = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.tcp_nagle = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.tcp_wsf_state = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.tcp_wsf = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.tcp_timer_scale = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.tcp_timestamp = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.redirect = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.def_task_mgmt_timeout = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.header_digest = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.data_digest = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.immediate_data = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.initial_r2t = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.data_seq_inorder = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.data_pdu_inorder = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.erl = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.max_receive_data_len = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.first_burst_len = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.max_outstanding_r2t = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.max_burst_len = 0
Oct 26 09:35:44 user nova-compute[74075]: iface.chap_auth = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.bidi_chap = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.strict_login_compliance = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.discovery_auth = <empty>
Oct 26 09:35:44 user nova-compute[74075]: iface.discovery_logout = <empty>
Oct 26 09:35:44 user nova-compute[74075]: node.discovery_address = <empty>
Oct 26 09:35:44 user nova-compute[74075]: node.discovery_port = 0
Oct 26 09:35:44 user nova-compute[74075]: node.discovery_type = static
Oct 26 09:35:44 user nova-compute[74075]: node.session.initial_cmdsn = 0
Oct 26 09:35:44 user nova-compute[74075]: node.session.initial_login_retry_max = 8
Oct 26 09:35:44 user nova-compute[74075]: node.session.xmit_thread_priority = -20
Oct 26 09:35:44 user nova-compute[74075]: node.session.cmds_max = 128
Oct 26 09:35:44 user nova-compute[74075]: node.session.queue_depth = 32
Oct 26 09:35:44 user nova-compute[74075]: node.session.nr_sessions = 1
Oct 26 09:35:44 user nova-compute[74075]: node.session.auth.authmethod = CHAP
Oct 26 09:35:44 user nova-compute[74075]: node.session.auth.username = cALwitfb
Oct 26 09:35:44 user nova-compute[74075]: node.session.auth.password = ***
Oct 26 09:35:44 user nova-compute[74075]: node.session.auth.username_in = <empty>
Oct 26 09:35:44 user nova-compute[74075]: node.session.auth.password_in = <empty>
Oct 26 09:35:44 user nova-compute[74075]: node.session.auth.chap_algs = MD5
Oct 26 09:35:44 user nova-compute[74075]: node.session.timeo.replacement_timeout = 120
Oct 26 09:35:44 user nova-compute[74075]: node.session.err_timeo.abort_timeout = 15
Oct 26 09:35:44 user nova-compute[74075]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 09:35:44 user nova-compute[74075]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 09:35:44 user nova-compute[74075]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.FastAbort = Yes
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.InitialR2T = No
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.ImmediateData = Yes
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.MaxConnections = 1
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 09:35:44 user nova-compute[74075]: node.session.iscsi.ERL = 0
Oct 26 09:35:44 user nova-compute[74075]: node.session.scan = manual
Oct 26 09:35:44 user nova-compute[74075]: node.session.reopen_max = 0
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].address = 172.16.0.220
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].port = 3260
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].startup = manual
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].tcp.window_size = 524288
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].tcp.type_of_service = 0
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].timeo.logout_timeout = 15
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].timeo.login_timeout = 15
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].timeo.auth_timeout = 45
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].iscsi.DataDigest = None
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].iscsi.IFMarker = No
Oct 26 09:35:44 user nova-compute[74075]: node.conn[0].iscsi.OFMarker = No
Oct 26 09:35:44 user nova-compute[74075]: # END RECORD
Oct 26 09:35:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c884d540-5cb7-4683-95b5-b2abb88d1114]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e3ac33-1f82-469e-afa4-e07d66ec6217]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cALwitfb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cALwitfb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e44c344-4206-4d5a-a6c4-21278ff36f76]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cALwitfb'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5099da17-a302-4a70-a724-70526f398d10]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b15038-3bea-45ea-b4d1-3252e3368f91]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:44 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:44 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:44 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:44 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[87789c70-af31-4415-bab3-e6875e0fcd3f]: (4, ('0 0 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '26637633765303730', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633765303730', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-192025782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-192025782',id=20,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-lxucicnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:33:58Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=8b522482-66ab-4ae4-b851-9e4b74433fe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "vif_mac": "fa:16:3e:ff:da:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "vif_mac": "fa:16:3e:ff:da:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.objects.base [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<8b522482-66ab-4ae4-b851-9e4b74433fe6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:35:44 user nova-compute[74075]:   <uuid>8b522482-66ab-4ae4-b851-9e4b74433fe6</uuid>
Oct 26 09:35:44 user nova-compute[74075]:   <name>instance-00000014</name>
Oct 26 09:35:44 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:35:44 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:35:44 user nova-compute[74075]:   <metadata>
Oct 26 09:35:44 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:35:44 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:35:44 user nova-compute[74075]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-192025782</nova:name>
Oct 26 09:35:44 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:35:44</nova:creationTime>
Oct 26 09:35:44 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:35:44 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:35:44 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:35:44 user nova-compute[74075]:       <nova:owner>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:user uuid="f05e6ea9a6e248e892fb237a31d4b1a1">tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member</nova:user>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:project uuid="abf8f091fdd04a9c8e5b14632402efae">tempest-ServerBootFromVolumeStableRescueTest-1733320520</nova:project>
Oct 26 09:35:44 user nova-compute[74075]:       </nova:owner>
Oct 26 09:35:44 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:35:44 user nova-compute[74075]:       <nova:ports>
Oct 26 09:35:44 user nova-compute[74075]:         <nova:port uuid="06454434-823c-4a71-a950-ff140c5e2003">
Oct 26 09:35:44 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:35:44 user nova-compute[74075]:         </nova:port>
Oct 26 09:35:44 user nova-compute[74075]:       </nova:ports>
Oct 26 09:35:44 user nova-compute[74075]:     </nova:instance>
Oct 26 09:35:44 user nova-compute[74075]:   </metadata>
Oct 26 09:35:44 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:35:44 user nova-compute[74075]:     <system>
Oct 26 09:35:44 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:35:44 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:35:44 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:35:44 user nova-compute[74075]:       <entry name="serial">8b522482-66ab-4ae4-b851-9e4b74433fe6</entry>
Oct 26 09:35:44 user nova-compute[74075]:       <entry name="uuid">8b522482-66ab-4ae4-b851-9e4b74433fe6</entry>
Oct 26 09:35:44 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:35:44 user nova-compute[74075]:     </system>
Oct 26 09:35:44 user nova-compute[74075]:   </sysinfo>
Oct 26 09:35:44 user nova-compute[74075]:   <os>
Oct 26 09:35:44 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:35:44 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:35:44 user nova-compute[74075]:   </os>
Oct 26 09:35:44 user nova-compute[74075]:   <features>
Oct 26 09:35:44 user nova-compute[74075]:     <acpi/>
Oct 26 09:35:44 user nova-compute[74075]:     <apic/>
Oct 26 09:35:44 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:35:44 user nova-compute[74075]:   </features>
Oct 26 09:35:44 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:35:44 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:35:44 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:35:44 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:35:44 user nova-compute[74075]:   </clock>
Oct 26 09:35:44 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:35:44 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:35:44 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:35:44 user nova-compute[74075]:   </cpu>
Oct 26 09:35:44 user nova-compute[74075]:   <devices>
Oct 26 09:35:44 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:35:44 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:35:44 user nova-compute[74075]:       <source dev="/dev/sdc"/>
Oct 26 09:35:44 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:35:44 user nova-compute[74075]:       <serial>4a945ccc-dbb8-4338-84ee-d7d247be53f2</serial>
Oct 26 09:35:44 user nova-compute[74075]:     </disk>
Oct 26 09:35:44 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:44 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:44 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue"/>
Oct 26 09:35:44 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:35:44 user nova-compute[74075]:       <boot order="1"/>
Oct 26 09:35:44 user nova-compute[74075]:     </disk>
Oct 26 09:35:44 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:35:44 user nova-compute[74075]:       <mac address="fa:16:3e:ff:da:f9"/>
Oct 26 09:35:44 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:44 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:35:44 user nova-compute[74075]:       <target dev="tap06454434-82"/>
Oct 26 09:35:44 user nova-compute[74075]:     </interface>
Oct 26 09:35:44 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:35:44 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/console.log" append="off"/>
Oct 26 09:35:44 user nova-compute[74075]:     </serial>
Oct 26 09:35:44 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:35:44 user nova-compute[74075]:     <video>
Oct 26 09:35:44 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:44 user nova-compute[74075]:     </video>
Oct 26 09:35:44 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:35:44 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:35:44 user nova-compute[74075]:     </rng>
Oct 26 09:35:44 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:35:44 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:35:44 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:35:44 user nova-compute[74075]:     </memballoon>
Oct 26 09:35:44 user nova-compute[74075]:   </devices>
Oct 26 09:35:44 user nova-compute[74075]: </domain>
Oct 26 09:35:44 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:35:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance destroyed successfully.
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No VIF found with MAC fa:16:3e:ff:da:f9, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-c895030a-c6f9-4e79-b584-c45fe22beeac req-ebfc932c-60d7-43f7-8057-745baa34a79a service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c895030a-c6f9-4e79-b584-c45fe22beeac req-ebfc932c-60d7-43f7-8057-745baa34a79a service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c895030a-c6f9-4e79-b584-c45fe22beeac req-ebfc932c-60d7-43f7-8057-745baa34a79a service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c895030a-c6f9-4e79-b584-c45fe22beeac req-ebfc932c-60d7-43f7-8057-745baa34a79a service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-c895030a-c6f9-4e79-b584-c45fe22beeac req-ebfc932c-60d7-43f7-8057-745baa34a79a service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:46 user nova-compute[74075]: WARNING nova.compute.manager [req-c895030a-c6f9-4e79-b584-c45fe22beeac req-ebfc932c-60d7-43f7-8057-745baa34a79a service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state active and task_state rescuing.
Oct 26 09:35:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ca916acf-59ef-44a4-98ee-7e5fbd09f4db tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:35:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-c1340bec-448b-4c1f-bec8-3cbff1f0eae6 req-ba10fcbd-3b7c-462b-8613-baa707869d75 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1340bec-448b-4c1f-bec8-3cbff1f0eae6 req-ba10fcbd-3b7c-462b-8613-baa707869d75 service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1340bec-448b-4c1f-bec8-3cbff1f0eae6 req-ba10fcbd-3b7c-462b-8613-baa707869d75 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1340bec-448b-4c1f-bec8-3cbff1f0eae6 req-ba10fcbd-3b7c-462b-8613-baa707869d75 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-c1340bec-448b-4c1f-bec8-3cbff1f0eae6 req-ba10fcbd-3b7c-462b-8613-baa707869d75 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:48 user nova-compute[74075]: WARNING nova.compute.manager [req-c1340bec-448b-4c1f-bec8-3cbff1f0eae6 req-ba10fcbd-3b7c-462b-8613-baa707869d75 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state rescued and task_state None.
Oct 26 09:35:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Starting finish_migration {{(pid=74075) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 09:35:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:35:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Creating image(s)
Oct 26 09:35:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk. size=21474836480 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk 21474836480 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk 21474836480" returned: 0 in 0.048s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start _get_guest_xml network_info=[{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'e5507fc6-8ac5-4212-adc8-11951c134cb0', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b0ef0258-9bcd-4caa-822f-114e85431fb5', 'attached_at': '2023-10-26T09:35:56.000000', 'detached_at': '', 'volume_id': '5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'serial': '5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:35:56 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:56 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:20:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:35:56 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:56 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:35:56 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d80caa5-dba1-409e-91c3-093a3f2e1d92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:35:56 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac896d-20cd-4719-bf97-5aa2abd7c64a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d] added
Oct 26 09:35:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925ce40-93a1-4bb2-8dd0-24d61e4b328d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05746ce-b960-4e78-999b-c6e1cc4bce97]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woOWEkuy {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woOWEkuy" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9345ea-84be-43e1-9159-6cb88040f8d0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woOWEkuy'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb336b-eea0-4a63-920c-5975e901eea6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec5d39-31f7-48ff-8dbf-6e8b9c6dc2b3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb123c1-0980-4811-802a-a9025c265818]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]
Oct 26 09:35:56 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.
Oct 26 09:35:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a124d68-0590-46f0-8c7a-a69e30a92278]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8a7c05-6800-4536-a7fe-dba9366183ce]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:35:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:35:56 user nova-compute[74075]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:35:56 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0254fc27-cb67-43cb-8be4-1a6af2478b47]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23662323839383564', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662323839383564', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:35:57 user nova-compute[74075]:   <uuid>b0ef0258-9bcd-4caa-822f-114e85431fb5</uuid>
Oct 26 09:35:57 user nova-compute[74075]:   <name>instance-0000000f</name>
Oct 26 09:35:57 user nova-compute[74075]:   <memory>2097152</memory>
Oct 26 09:35:57 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:35:57 user nova-compute[74075]:   <metadata>
Oct 26 09:35:57 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:35:57 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:35:57 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherB-server-1332623435</nova:name>
Oct 26 09:35:57 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:35:56</nova:creationTime>
Oct 26 09:35:57 user nova-compute[74075]:       <nova:flavor name="m1.small">
Oct 26 09:35:57 user nova-compute[74075]:         <nova:memory>2048</nova:memory>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:disk>20</nova:disk>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:35:57 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:35:57 user nova-compute[74075]:       <nova:owner>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:user uuid="577f9cb60ea940e48405553a6ddc7c18">tempest-ServerActionsTestOtherB-250783807-project-member</nova:user>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:project uuid="a8c9daadd77642879f80a0233e0cb7fa">tempest-ServerActionsTestOtherB-250783807</nova:project>
Oct 26 09:35:57 user nova-compute[74075]:       </nova:owner>
Oct 26 09:35:57 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:35:57 user nova-compute[74075]:       <nova:ports>
Oct 26 09:35:57 user nova-compute[74075]:         <nova:port uuid="0f2ea36f-be05-482a-bd66-736c4d8b36f0">
Oct 26 09:35:57 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:35:57 user nova-compute[74075]:         </nova:port>
Oct 26 09:35:57 user nova-compute[74075]:       </nova:ports>
Oct 26 09:35:57 user nova-compute[74075]:     </nova:instance>
Oct 26 09:35:57 user nova-compute[74075]:   </metadata>
Oct 26 09:35:57 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:35:57 user nova-compute[74075]:     <system>
Oct 26 09:35:57 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:35:57 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:35:57 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:35:57 user nova-compute[74075]:       <entry name="serial">b0ef0258-9bcd-4caa-822f-114e85431fb5</entry>
Oct 26 09:35:57 user nova-compute[74075]:       <entry name="uuid">b0ef0258-9bcd-4caa-822f-114e85431fb5</entry>
Oct 26 09:35:57 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:35:57 user nova-compute[74075]:     </system>
Oct 26 09:35:57 user nova-compute[74075]:   </sysinfo>
Oct 26 09:35:57 user nova-compute[74075]:   <os>
Oct 26 09:35:57 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:35:57 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:35:57 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:35:57 user nova-compute[74075]:   </os>
Oct 26 09:35:57 user nova-compute[74075]:   <features>
Oct 26 09:35:57 user nova-compute[74075]:     <acpi/>
Oct 26 09:35:57 user nova-compute[74075]:     <apic/>
Oct 26 09:35:57 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:35:57 user nova-compute[74075]:   </features>
Oct 26 09:35:57 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:35:57 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:35:57 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:35:57 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:35:57 user nova-compute[74075]:   </clock>
Oct 26 09:35:57 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:35:57 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:35:57 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:35:57 user nova-compute[74075]:   </cpu>
Oct 26 09:35:57 user nova-compute[74075]:   <devices>
Oct 26 09:35:57 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:35:57 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:35:57 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk"/>
Oct 26 09:35:57 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:35:57 user nova-compute[74075]:     </disk>
Oct 26 09:35:57 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:35:57 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:35:57 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:35:57 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:35:57 user nova-compute[74075]:       <serial>5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d</serial>
Oct 26 09:35:57 user nova-compute[74075]:     </disk>
Oct 26 09:35:57 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:35:57 user nova-compute[74075]:       <mac address="fa:16:3e:7d:66:e0"/>
Oct 26 09:35:57 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:57 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:35:57 user nova-compute[74075]:       <target dev="tap0f2ea36f-be"/>
Oct 26 09:35:57 user nova-compute[74075]:     </interface>
Oct 26 09:35:57 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:35:57 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/console.log" append="off"/>
Oct 26 09:35:57 user nova-compute[74075]:     </serial>
Oct 26 09:35:57 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:35:57 user nova-compute[74075]:     <video>
Oct 26 09:35:57 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:35:57 user nova-compute[74075]:     </video>
Oct 26 09:35:57 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:35:57 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:35:57 user nova-compute[74075]:     </rng>
Oct 26 09:35:57 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:35:57 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:35:57 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:35:57 user nova-compute[74075]:     </memballoon>
Oct 26 09:35:57 user nova-compute[74075]:   </devices>
Oct 26 09:35:57 user nova-compute[74075]: </domain>
Oct 26 09:35:57 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1507576254-network", "vif_mac": "fa:16:3e:7d:66:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG os_vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '812f6361-a863-5944-baeb-cb5cf941cd1e', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f2ea36f-be, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f2ea36f-be, col_values=(('qos', UUID('4f5ea78e-722b-434c-9913-291e3a2cc83a')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f2ea36f-be, col_values=(('external_ids', {'iface-id': '0f2ea36f-be05-482a-bd66-736c4d8b36f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:66:e0', 'vm-uuid': 'b0ef0258-9bcd-4caa-822f-114e85431fb5'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:57 user nova-compute[74075]: INFO os_vif [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be')
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:35:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] No VIF found with MAC fa:16:3e:7d:66:e0, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-b60419af-4271-42f6-b25b-c19aac9c3fd9 req-096c016d-b19c-4f00-8a93-0219f302a7a3 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b60419af-4271-42f6-b25b-c19aac9c3fd9 req-096c016d-b19c-4f00-8a93-0219f302a7a3 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b60419af-4271-42f6-b25b-c19aac9c3fd9 req-096c016d-b19c-4f00-8a93-0219f302a7a3 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b60419af-4271-42f6-b25b-c19aac9c3fd9 req-096c016d-b19c-4f00-8a93-0219f302a7a3 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-b60419af-4271-42f6-b25b-c19aac9c3fd9 req-096c016d-b19c-4f00-8a93-0219f302a7a3 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:35:59 user nova-compute[74075]: WARNING nova.compute.manager [req-b60419af-4271-42f6-b25b-c19aac9c3fd9 req-096c016d-b19c-4f00-8a93-0219f302a7a3 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state resize_finish.
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:35:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:36:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance running successfully.
Oct 26 09:36:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Failed to set time: agent not configured {{(pid=74075) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2a37ec58-4062-4387-88ed-4d9d23a4e4ea tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] finish_migration finished successfully. {{(pid=74075) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-9bf49b80-7d82-404e-ae22-c188686490d6 req-47eed499-c389-43e6-b6f7-40c1918c0eb7 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9bf49b80-7d82-404e-ae22-c188686490d6 req-47eed499-c389-43e6-b6f7-40c1918c0eb7 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9bf49b80-7d82-404e-ae22-c188686490d6 req-47eed499-c389-43e6-b6f7-40c1918c0eb7 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9bf49b80-7d82-404e-ae22-c188686490d6 req-47eed499-c389-43e6-b6f7-40c1918c0eb7 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-9bf49b80-7d82-404e-ae22-c188686490d6 req-47eed499-c389-43e6-b6f7-40c1918c0eb7 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:36:01 user nova-compute[74075]: WARNING nova.compute.manager [req-9bf49b80-7d82-404e-ae22-c188686490d6 req-47eed499-c389-43e6-b6f7-40c1918c0eb7 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state resize_finish.
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:36:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:36:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7345MB free_disk=25.25649642944336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Applying migration context for instance b0ef0258-9bcd-4caa-822f-114e85431fb5 as it has an incoming, in-progress migration 0d67b7d3-00b2-47ff-8162-b11934b27b76. Migration status is finished {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 09:36:02 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating resource usage from migration 0d67b7d3-00b2-47ff-8162-b11934b27b76
Oct 26 09:36:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ac9fb9dc-3c56-4ec9-aec4-86a178160950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Migration 0d67b7d3-00b2-47ff-8162-b11934b27b76 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 26902518-83b8-4811-a1bb-fc70a8786fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:36:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:36:03 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:36:03 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:36:03 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:36:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:36:04 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [{"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-8999f490-1fc8-443a-bfaa-6a580681f2b8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:36:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-changed-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Refreshing instance network info cache due to event network-changed-46466255-14c7-44ca-a9f2-ba113a2f6c7b. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] Acquiring lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] Acquired lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Refreshing network info cache for port 46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updated VIF entry in instance network info cache for port 46466255-14c7-44ca-a9f2-ba113a2f6c7b. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating instance_info_cache with network_info: [{"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-baad547e-dbb7-452d-8d9a-59935143ebf7 req-379bb6b1-a2d3-4b5a-af64-f50341b4edbb service nova] Releasing lock "refresh_cache-1d69c28a-91cb-47b3-b58d-0391ff8029c6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'flavor' on Instance uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:36:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:36:58 user nova-compute[74075]: INFO nova.compute.manager [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attaching volume 4e06e564-21de-4bc9-925c-8c5eee3771b5 to /dev/vdb
Oct 26 09:36:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442e53a-6f5f-467a-9fab-d103c40c02eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8087994b-b566-4818-85a4-c2bcc11442b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272cb0b-2af7-4f23-bdb7-bfcdc4617515]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeba3f5-db3f-43e0-a93f-a5d2f10a68bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:36:58 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e0526-a97a-4c3c-a0b9-a97bc940f9f8]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating existing volume attachment record: d8cf5019-a29d-4c3d-ba2d-465f203cddf1 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:36:58 user nova-compute[74075]: INFO nova.compute.manager [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Unrescuing
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:36:58 user nova-compute[74075]: DEBUG nova.network.neutron [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG nova.network.neutron [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG nova.objects.instance [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'flavor' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-2c0d57e7-5a62-4773-8ffb-eac60a09dbda req-78fe05e3-3abe-4530-a6fd-1e87ffe651a3 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2c0d57e7-5a62-4773-8ffb-eac60a09dbda req-78fe05e3-3abe-4530-a6fd-1e87ffe651a3 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2c0d57e7-5a62-4773-8ffb-eac60a09dbda req-78fe05e3-3abe-4530-a6fd-1e87ffe651a3 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2c0d57e7-5a62-4773-8ffb-eac60a09dbda req-78fe05e3-3abe-4530-a6fd-1e87ffe651a3 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-2c0d57e7-5a62-4773-8ffb-eac60a09dbda req-78fe05e3-3abe-4530-a6fd-1e87ffe651a3 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:36:59 user nova-compute[74075]: WARNING nova.compute.manager [req-2c0d57e7-5a62-4773-8ffb-eac60a09dbda req-78fe05e3-3abe-4530-a6fd-1e87ffe651a3 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:36:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:36:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance destroyed successfully.
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:37:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:01 user nova-compute[74075]: WARNING nova.compute.manager [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:01 user nova-compute[74075]: WARNING nova.compute.manager [req-b10889fd-23dc-4301-8ac6-c20f2b62e392 req-a66b4b33-a330-4c10-95f2-97fa95125155 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:03 user nova-compute[74075]: INFO nova.compute.manager [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Terminating instance
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-349d61fe-8865-4c1e-8c68-7f389a65b584 req-6c731c2a-dc78-4ab3-a34e-932d2043e566 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-vif-unplugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-349d61fe-8865-4c1e-8c68-7f389a65b584 req-6c731c2a-dc78-4ab3-a34e-932d2043e566 service nova] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-349d61fe-8865-4c1e-8c68-7f389a65b584 req-6c731c2a-dc78-4ab3-a34e-932d2043e566 service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-349d61fe-8865-4c1e-8c68-7f389a65b584 req-6c731c2a-dc78-4ab3-a34e-932d2043e566 service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-349d61fe-8865-4c1e-8c68-7f389a65b584 req-6c731c2a-dc78-4ab3-a34e-932d2043e566 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] No waiting events found dispatching network-vif-unplugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-349d61fe-8865-4c1e-8c68-7f389a65b584 req-6c731c2a-dc78-4ab3-a34e-932d2043e566 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-vif-unplugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-240d6488-abcb-445f-a741-75b39882b2d7 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:03 user nova-compute[74075]: WARNING nova.compute.manager [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state active and task_state None.
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-changed-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Refreshing instance network info cache due to event network-changed-d9f2dfc4-35d0-434e-a604-927b009a1d07. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] Acquiring lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] Acquired lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Refreshing network info cache for port d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Instance destroyed successfully.
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'resources' on Instance uuid ac9fb9dc-3c56-4ec9-aec4-86a178160950 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-64765265',display_name='tempest-AttachVolumeNegativeTest-server-64765265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-64765265',id=23,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ87IRmtwQ31ZpVs0miiqE0oSZHXSOCBh4JdlgO+4aY6VN9tDh46TgIWm69LGR+IRusoRA9tVtAcuxoi91UMv3Anmtmj8A6GZIsZJ8AHaxP4w3hHUuTEukZSwNuvc/g9A==',key_name='tempest-keypair-555115776',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-fx50zliz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=ac9fb9dc-3c56-4ec9-aec4-86a178160950,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG os_vif [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9f2dfc4-35, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc42f70c-65f1-4b73-a1f3-cb81d2859ba9) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:04 user nova-compute[74075]: INFO os_vif [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9d:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9f2dfc4-35d0-434e-a604-927b009a1d07,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2dfc4-35')
Oct 26 09:37:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Deleting instance files /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950_del
Oct 26 09:37:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Deletion of /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950_del complete
Oct 26 09:37:04 user nova-compute[74075]: INFO nova.compute.manager [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json" returned: 1 in 0.209s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk --force-share --output=json' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000017, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ac9fb9dc-3c56-4ec9-aec4-86a178160950/disk
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Updated VIF entry in instance network info cache for port d9f2dfc4-35d0-434e-a604-927b009a1d07. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Updating instance_info_cache with network_info: [{"id": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "address": "fa:16:3e:09:9d:c6", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2dfc4-35", "ovs_interfaceid": "d9f2dfc4-35d0-434e-a604-927b009a1d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26d33e5b-6523-47a1-833f-1f180f7eef28 req-e56ab43c-da5f-40c7-83f0-094d7af53179 service nova] Releasing lock "refresh_cache-ac9fb9dc-3c56-4ec9-aec4-86a178160950" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:04 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Took 0.79 seconds to deallocate network for instance.
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:37:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] Acquiring lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] No waiting events found dispatching network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:05 user nova-compute[74075]: WARNING nova.compute.manager [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received unexpected event network-vif-plugged-d9f2dfc4-35d0-434e-a604-927b009a1d07 for instance with vm_state deleted and task_state None.
Oct 26 09:37:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-7e3914f4-23b3-4fb5-8593-2ab0c42abac6 req-19c36d8d-6631-440d-b2c2-b47048fdef34 service nova] [instance: ac9fb9dc-3c56-4ec9-aec4-86a178160950] Received event network-vif-deleted-d9f2dfc4-35d0-434e-a604-927b009a1d07 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:37:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:37:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.240787506103516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.009s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.124s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:06 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Deleted allocations for instance ac9fb9dc-3c56-4ec9-aec4-86a178160950
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Applying migration context for instance b0ef0258-9bcd-4caa-822f-114e85431fb5 as it has an incoming, in-progress migration 0d67b7d3-00b2-47ff-8162-b11934b27b76. Migration status is finished {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 09:37:06 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating resource usage from migration 0d67b7d3-00b2-47ff-8162-b11934b27b76
Oct 26 09:37:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3b8db9c7-2967-4f1f-ac9f-5376ccbd3cd4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "ac9fb9dc-3c56-4ec9-aec4-86a178160950" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.070s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Migration 0d67b7d3-00b2-47ff-8162-b11934b27b76 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 26902518-83b8-4811-a1bb-fc70a8786fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:37:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:37:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [{"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-839ef064-055b-4050-9c92-8913891abfe3" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:37:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:37:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:20 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Port 0f2ea36f-be05-482a-bd66-736c4d8b36f0 binding to destination host user is already ACTIVE {{(pid=74075) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 09:37:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:20 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Creating tmpfile /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/tmpurp5wimb to verify with other compute node that the instance is on the same shared storage. {{(pid=74075) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-45989309-2dec-4eae-8fe8-0d1909bb9e0c req-8fd925e2-1ba2-4dcf-a10f-82fb857be1b6 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-45989309-2dec-4eae-8fe8-0d1909bb9e0c req-8fd925e2-1ba2-4dcf-a10f-82fb857be1b6 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-45989309-2dec-4eae-8fe8-0d1909bb9e0c req-8fd925e2-1ba2-4dcf-a10f-82fb857be1b6 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-45989309-2dec-4eae-8fe8-0d1909bb9e0c req-8fd925e2-1ba2-4dcf-a10f-82fb857be1b6 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-45989309-2dec-4eae-8fe8-0d1909bb9e0c req-8fd925e2-1ba2-4dcf-a10f-82fb857be1b6 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:21 user nova-compute[74075]: WARNING nova.compute.manager [req-45989309-2dec-4eae-8fe8-0d1909bb9e0c req-8fd925e2-1ba2-4dcf-a10f-82fb857be1b6 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state resized and task_state resize_reverting.
Oct 26 09:37:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:22 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance destroyed successfully.
Oct 26 09:37:22 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'resources' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f2ea36f-be, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f5ea78e-722b-434c-9913-291e3a2cc83a) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:22 user nova-compute[74075]: INFO os_vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be')
Oct 26 09:37:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:22 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c6a87f-5959-4ee0-9c55-3ebb534aad6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:37:22 user nova-compute[74075]: No targets found.
Oct 26 09:37:22 user nova-compute[74075]: iSNS:
Oct 26 09:37:22 user nova-compute[74075]: No targets found.
Oct 26 09:37:22 user nova-compute[74075]: STATIC:
Oct 26 09:37:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:37:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:37:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:37:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:37:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:22 user nova-compute[74075]: FIRMWARE:
Oct 26 09:37:22 user nova-compute[74075]: No targets found.
Oct 26 09:37:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:37:22 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:37:22 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8b1b64-8e5c-4335-9c61-568f7a0b66a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4d6b85-45f2-4088-bdf1-be4665c45007]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:22 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:22 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:22 user nova-compute[74075]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:22 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:22 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:22 user nova-compute[74075]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f466433f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e0faf-86e7-4934-b731-4a1d92269109]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fa65a6-ecaf-4476-86c9-f94e173f4894]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4d7b6d-5d39-498c-9fbf-6840fa1f6590]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc88e62-3ecd-4116-91c0-72b54f9f2362]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e6ec6-a203-49b0-9fe2-b608273c7a65]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a451a-f10c-4258-b1c2-e02d5255ec05]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]
Oct 26 09:37:22 user nova-compute[74075]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.
Oct 26 09:37:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a796a0-50f6-4ce6-9a98-3cd23ed1b46a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== disconnect_volume: return (340ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'migration_context' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.objects.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Object Instance<b0ef0258-9bcd-4caa-822f-114e85431fb5> lazy-loaded attributes: resources,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-6e1410b2-2ab8-4ffe-be63-34804dc47cde req-c9d1ffc0-c7a9-4a21-9cc5-6c32c9556a82 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6e1410b2-2ab8-4ffe-be63-34804dc47cde req-c9d1ffc0-c7a9-4a21-9cc5-6c32c9556a82 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6e1410b2-2ab8-4ffe-be63-34804dc47cde req-c9d1ffc0-c7a9-4a21-9cc5-6c32c9556a82 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6e1410b2-2ab8-4ffe-be63-34804dc47cde req-c9d1ffc0-c7a9-4a21-9cc5-6c32c9556a82 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-6e1410b2-2ab8-4ffe-be63-34804dc47cde req-c9d1ffc0-c7a9-4a21-9cc5-6c32c9556a82 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:23 user nova-compute[74075]: WARNING nova.compute.manager [req-6e1410b2-2ab8-4ffe-be63-34804dc47cde req-c9d1ffc0-c7a9-4a21-9cc5-6c32c9556a82 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state resized and task_state resize_reverting.
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-changed-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Refreshing instance network info cache due to event network-changed-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] Acquiring lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] Acquired lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG nova.network.neutron [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Refreshing network info cache for port 0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:37:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.496s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:24 user nova-compute[74075]: INFO nova.compute.manager [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Swapping old allocation on dict_keys(['cc391394-3043-4569-8b55-9a33029ee3cb']) held by migration 0d67b7d3-00b2-47ff-8162-b11934b27b76 for instance
Oct 26 09:37:24 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Overwriting current allocation {'allocations': {'cc391394-3043-4569-8b55-9a33029ee3cb': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 28}}, 'project_id': 'a8c9daadd77642879f80a0233e0cb7fa', 'user_id': '577f9cb60ea940e48405553a6ddc7c18', 'consumer_generation': 1} on consumer b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updated VIF entry in instance network info cache for port 0287d2e8-161d-4c34-94c7-22e3cbe0ebc4. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG nova.network.neutron [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updating instance_info_cache with network_info: [{"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3ff1fab8-de95-42d5-8d1d-8a9dab0e0805 req-c950942d-8761-40dd-8d88-619dafc9e869 service nova] Releasing lock "refresh_cache-26902518-83b8-4811-a1bb-fc70a8786fbd" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG os_brick.utils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cc189-cd9a-41a0-bfee-4308d363a8e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae4c84-c49b-4f44-a70c-4d07fe804fff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d5300a-c2ad-4070-ba9f-9e26a5098c7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2212794c-7d86-43bd-b3ca-fc86953308f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:24 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:37:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[963087e9-075c-4016-ab0b-c0f400c83046]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG os_brick.utils [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:29 user nova-compute[74075]: INFO nova.compute.manager [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attaching volume a50e01ef-a276-4f60-9a43-57b9893fa037 to /dev/vdb
Oct 26 09:37:29 user nova-compute[74075]: DEBUG os_brick.utils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1fdd70-f678-4727-994a-b0b07f7ab9e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01bf2b8-5c43-4406-8ffe-734dc1e9a36a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[511cd8a7-8a4f-4598-ba13-fa3d229b68e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7c80b-b894-48e0-bfb2-11e1da69e75a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:29 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:37:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fbd72d-0e38-42c9-8a3b-1540de05830c]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG os_brick.utils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:29 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updating existing volume attachment record: ec0f35c8-f4c5-41a8-98ac-d663c2efc712 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:37:31 user nova-compute[74075]: INFO nova.compute.manager [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Unrescuing
Oct 26 09:37:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:31 user nova-compute[74075]: DEBUG nova.network.neutron [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:37:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG nova.network.neutron [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG nova.objects.instance [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'flavor' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1f85ffe-420d-4709-8699-966e5a4b538f req-a8bd377a-ac49-4d2e-9e15-1168089e52e6 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1f85ffe-420d-4709-8699-966e5a4b538f req-a8bd377a-ac49-4d2e-9e15-1168089e52e6 service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1f85ffe-420d-4709-8699-966e5a4b538f req-a8bd377a-ac49-4d2e-9e15-1168089e52e6 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1f85ffe-420d-4709-8699-966e5a4b538f req-a8bd377a-ac49-4d2e-9e15-1168089e52e6 service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1f85ffe-420d-4709-8699-966e5a4b538f req-a8bd377a-ac49-4d2e-9e15-1168089e52e6 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:32 user nova-compute[74075]: WARNING nova.compute.manager [req-e1f85ffe-420d-4709-8699-966e5a4b538f req-a8bd377a-ac49-4d2e-9e15-1168089e52e6 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:37:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance destroyed successfully.
Oct 26 09:37:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:34 user nova-compute[74075]: WARNING nova.compute.manager [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:37:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:34 user nova-compute[74075]: WARNING nova.compute.manager [req-647a33af-b499-461b-9d69-8c8c4487f31d req-4e0b2661-3cc8-47dd-b236-6100c1acabdf service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:37:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-54314fbf-2172-49f5-a0db-fdda96f472ba tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:37:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-12ccb42d-0311-4bf2-a1f9-a206aecaf6f5 req-f17ae5d2-8a30-4353-80d6-64b842e3902d service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12ccb42d-0311-4bf2-a1f9-a206aecaf6f5 req-f17ae5d2-8a30-4353-80d6-64b842e3902d service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12ccb42d-0311-4bf2-a1f9-a206aecaf6f5 req-f17ae5d2-8a30-4353-80d6-64b842e3902d service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12ccb42d-0311-4bf2-a1f9-a206aecaf6f5 req-f17ae5d2-8a30-4353-80d6-64b842e3902d service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-12ccb42d-0311-4bf2-a1f9-a206aecaf6f5 req-f17ae5d2-8a30-4353-80d6-64b842e3902d service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:36 user nova-compute[74075]: WARNING nova.compute.manager [req-12ccb42d-0311-4bf2-a1f9-a206aecaf6f5 req-f17ae5d2-8a30-4353-80d6-64b842e3902d service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state active and task_state None.
Oct 26 09:37:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:46 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:46 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:46 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c9c5c-6110-4982-98a5-29e29c80475f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:37:46 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b3b83-c59c-47ed-973b-7a8317ea8051]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5] added
Oct 26 09:37:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ae3c09-eb03-451c-8be7-1e800e91813c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42dcdc-988d-4608-9283-8f11923c17ed]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnLOimAv {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnLOimAv" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae7d8b1-90ca-4f7e-86e4-e04e8ec431de]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnLOimAv'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db33dc-4403-4ecd-8dc5-4b4e7b07d192]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3285378-731f-45d8-acad-bf601c77c125]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e304bf1-7255-4929-a914-1542465085c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]
Oct 26 09:37:46 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.
Oct 26 09:37:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf3aef-6697-4d7b-b3e3-fbae411b6f4f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0300c73-e6ee-4200-8b26-1ff2a2085c28]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:46 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:46 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f4482-8e37-45a5-8d88-c79246f497dd]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:37:46 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23931383030393530', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383030393530', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'flavor' on Instance uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:37:47 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:37:47 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:37:47 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:37:47 user nova-compute[74075]:   <serial>4e06e564-21de-4bc9-925c-8c5eee3771b5</serial>
Oct 26 09:37:47 user nova-compute[74075]: </disk>
Oct 26 09:37:47 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:37:48 user nova-compute[74075]: INFO nova.compute.claims [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Claim successful on node user
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No VIF found with MAC fa:16:3e:00:07:6b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b193e6df-d485-44b0-9c64-ec31f29a9b95 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.080s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:37:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.policy [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '701652cea9c342469f8b4bed5c3b89c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c735fb27274a10a4005325bc5d9e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:37:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Creating image(s)
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "/opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "/opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "/opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Starting finish_revert_migration {{(pid=74075) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start _get_guest_xml network_info=[{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'f92696fe-d823-4fd1-97f1-fa31c0884a8d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b0ef0258-9bcd-4caa-822f-114e85431fb5', 'attached_at': '2023-10-26T09:37:49.000000', 'detached_at': '', 'volume_id': '5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'serial': '5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:37:48 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:37:48 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:48 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:48 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:48 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[332818a1-4e60-4b21-90a2-62aa99e7893a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:37:48 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.214s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f48b028-f3b2-44c8-8001-8418431fca23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d] added
Oct 26 09:37:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAjVyBvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:49 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f519719a-07f3-4056-a78a-0358c43fefb2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c62be3b-08c7-4145-96fb-32cd8d5fe61c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woOWEkuy {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woOWEkuy" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e2e787-bfac-45fd-bb6d-2fe47849cda2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woOWEkuy'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c496744-f54e-4b5a-bd19-b1873e0fc103]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcfda3b-4d26-434e-8a36-f370d29fa40d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk 1073741824" returned: 0 in 0.060s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dde3ff-0cbb-4f14-8ce6-cf8270e30f5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Successfully created port: 67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]
Oct 26 09:37:49 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.
Oct 26 09:37:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b90a171-d5b9-48d5-9a9e-f96413a3641e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35ac30-ae6d-4194-8584-c7945a13dfc7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:49 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:49 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f465a2-4d54-43cf-9f9f-cc10918959eb]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.246s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Cannot resize image /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Ensure instance console log exists: /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:49 user nova-compute[74075]: INFO nova.compute.manager [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Rebuilding instance
Oct 26 09:37:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Successfully updated port: 67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "refresh_cache-99c57de9-bad9-41f7-9b09-9b2e5ac85521" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquired lock "refresh_cache-99c57de9-bad9-41f7-9b09-9b2e5ac85521" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-changed-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Refreshing instance network info cache due to event network-changed-67ab4aee-3319-4e9c-b35b-d6ef736c3e14. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] Acquiring lock "refresh_cache-99c57de9-bad9-41f7-9b09-9b2e5ac85521" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-a024e554-6e02-4cc5-8dce-f1f45a1e39d6 req-9aee8e57-9c5d-4822-a74d-11619e92a198 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-unplugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a024e554-6e02-4cc5-8dce-f1f45a1e39d6 req-9aee8e57-9c5d-4822-a74d-11619e92a198 service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a024e554-6e02-4cc5-8dce-f1f45a1e39d6 req-9aee8e57-9c5d-4822-a74d-11619e92a198 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a024e554-6e02-4cc5-8dce-f1f45a1e39d6 req-9aee8e57-9c5d-4822-a74d-11619e92a198 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-a024e554-6e02-4cc5-8dce-f1f45a1e39d6 req-9aee8e57-9c5d-4822-a74d-11619e92a198 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-unplugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:50 user nova-compute[74075]: WARNING nova.compute.manager [req-a024e554-6e02-4cc5-8dce-f1f45a1e39d6 req-9aee8e57-9c5d-4822-a74d-11619e92a198 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-unplugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state active and task_state rebuilding.
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23662323839383564', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662323839383564', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.409s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:50 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:50 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c61bb1-5905-452b-94e6-c0450fd93410]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:37:50 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:37:50 user nova-compute[74075]:   <uuid>b0ef0258-9bcd-4caa-822f-114e85431fb5</uuid>
Oct 26 09:37:50 user nova-compute[74075]:   <name>instance-0000000f</name>
Oct 26 09:37:50 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:37:50 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:37:50 user nova-compute[74075]:   <metadata>
Oct 26 09:37:50 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:37:50 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherB-server-1332623435</nova:name>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:37:48</nova:creationTime>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:37:50 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:37:50 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:owner>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:user uuid="577f9cb60ea940e48405553a6ddc7c18">tempest-ServerActionsTestOtherB-250783807-project-member</nova:user>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:project uuid="a8c9daadd77642879f80a0233e0cb7fa">tempest-ServerActionsTestOtherB-250783807</nova:project>
Oct 26 09:37:50 user nova-compute[74075]:       </nova:owner>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:ports>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:port uuid="0f2ea36f-be05-482a-bd66-736c4d8b36f0">
Oct 26 09:37:50 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:37:50 user nova-compute[74075]:         </nova:port>
Oct 26 09:37:50 user nova-compute[74075]:       </nova:ports>
Oct 26 09:37:50 user nova-compute[74075]:     </nova:instance>
Oct 26 09:37:50 user nova-compute[74075]:   </metadata>
Oct 26 09:37:50 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:37:50 user nova-compute[74075]:     <system>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="serial">b0ef0258-9bcd-4caa-822f-114e85431fb5</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="uuid">b0ef0258-9bcd-4caa-822f-114e85431fb5</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:37:50 user nova-compute[74075]:     </system>
Oct 26 09:37:50 user nova-compute[74075]:   </sysinfo>
Oct 26 09:37:50 user nova-compute[74075]:   <os>
Oct 26 09:37:50 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:37:50 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:37:50 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:37:50 user nova-compute[74075]:   </os>
Oct 26 09:37:50 user nova-compute[74075]:   <features>
Oct 26 09:37:50 user nova-compute[74075]:     <acpi/>
Oct 26 09:37:50 user nova-compute[74075]:     <apic/>
Oct 26 09:37:50 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:37:50 user nova-compute[74075]:   </features>
Oct 26 09:37:50 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:37:50 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:37:50 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:37:50 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:37:50 user nova-compute[74075]:   </clock>
Oct 26 09:37:50 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:37:50 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:37:50 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:37:50 user nova-compute[74075]:   </cpu>
Oct 26 09:37:50 user nova-compute[74075]:   <devices>
Oct 26 09:37:50 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:37:50 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:37:50 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk"/>
Oct 26 09:37:50 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:     </disk>
Oct 26 09:37:50 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:37:50 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:37:50 user nova-compute[74075]:       <source dev="/dev/sdd"/>
Oct 26 09:37:50 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:       <serial>5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d</serial>
Oct 26 09:37:50 user nova-compute[74075]:     </disk>
Oct 26 09:37:50 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:37:50 user nova-compute[74075]:       <mac address="fa:16:3e:7d:66:e0"/>
Oct 26 09:37:50 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:37:50 user nova-compute[74075]:       <target dev="tap0f2ea36f-be"/>
Oct 26 09:37:50 user nova-compute[74075]:     </interface>
Oct 26 09:37:50 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:37:50 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/console.log" append="off"/>
Oct 26 09:37:50 user nova-compute[74075]:     </serial>
Oct 26 09:37:50 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:37:50 user nova-compute[74075]:     <video>
Oct 26 09:37:50 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:     </video>
Oct 26 09:37:50 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:37:50 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:37:50 user nova-compute[74075]:     </rng>
Oct 26 09:37:50 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:37:50 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:37:50 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:37:50 user nova-compute[74075]:     </memballoon>
Oct 26 09:37:50 user nova-compute[74075]:   </devices>
Oct 26 09:37:50 user nova-compute[74075]: </domain>
Oct 26 09:37:50 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b27d6-e955-4514-9adc-9946b9e922aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037] added
Oct 26 09:37:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '812f6361-a863-5944-baeb-cb5cf941cd1e', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b416b9-4dc5-4783-97a6-8d8876dc2e23]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f2ea36f-be, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f2ea36f-be, col_values=(('qos', UUID('dd931e03-94d3-44f9-9748-2b6a5dabebef')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f2ea36f-be, col_values=(('external_ids', {'iface-id': '0f2ea36f-be05-482a-bd66-736c4d8b36f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:66:e0', 'vm-uuid': 'b0ef0258-9bcd-4caa-822f-114e85431fb5'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[208ac384-0c88-483e-adf3-b39b7b738b27]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cAjVyBvk {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: INFO os_vif [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be')
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cAjVyBvk" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f7e26-2389-40ef-b600-e7e89875bb94]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cAjVyBvk'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Updating instance_info_cache with network_info: [{"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Releasing lock "refresh_cache-99c57de9-bad9-41f7-9b09-9b2e5ac85521" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Instance network_info: |[{"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] Acquired lock "refresh_cache-99c57de9-bad9-41f7-9b09-9b2e5ac85521" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.neutron [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Refreshing network info cache for port 67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Start _get_guest_xml network_info=[{"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[131a2b9e-f130-4652-83cb-b33d6e8da95e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:37:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1140593622',display_name='tempest-VolumesActionsTest-instance-1140593622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1140593622',id=25,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2c735fb27274a10a4005325bc5d9e4c',ramdisk_id='',reservation_id='r-zj8mo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450383175',owner_user_name='tempest-VolumesActionsTest-1450383175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:37:49Z,user_data=None,user_id='701652cea9c342469f8b4bed5c3b89c1',uuid=99c57de9-bad9-41f7-9b09-9b2e5ac85521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converting VIF {"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.objects.instance [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lazy-loading 'pci_devices' on Instance uuid 99c57de9-bad9-41f7-9b09-9b2e5ac85521 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058f292-1d58-4798-ac6c-50689f67410a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:37:50 user nova-compute[74075]:   <uuid>99c57de9-bad9-41f7-9b09-9b2e5ac85521</uuid>
Oct 26 09:37:50 user nova-compute[74075]:   <name>instance-00000019</name>
Oct 26 09:37:50 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:37:50 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:37:50 user nova-compute[74075]:   <metadata>
Oct 26 09:37:50 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:37:50 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:name>tempest-VolumesActionsTest-instance-1140593622</nova:name>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:37:50</nova:creationTime>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:37:50 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:37:50 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:owner>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:user uuid="701652cea9c342469f8b4bed5c3b89c1">tempest-VolumesActionsTest-1450383175-project-member</nova:user>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:project uuid="d2c735fb27274a10a4005325bc5d9e4c">tempest-VolumesActionsTest-1450383175</nova:project>
Oct 26 09:37:50 user nova-compute[74075]:       </nova:owner>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:37:50 user nova-compute[74075]:       <nova:ports>
Oct 26 09:37:50 user nova-compute[74075]:         <nova:port uuid="67ab4aee-3319-4e9c-b35b-d6ef736c3e14">
Oct 26 09:37:50 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 09:37:50 user nova-compute[74075]:         </nova:port>
Oct 26 09:37:50 user nova-compute[74075]:       </nova:ports>
Oct 26 09:37:50 user nova-compute[74075]:     </nova:instance>
Oct 26 09:37:50 user nova-compute[74075]:   </metadata>
Oct 26 09:37:50 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:37:50 user nova-compute[74075]:     <system>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="serial">99c57de9-bad9-41f7-9b09-9b2e5ac85521</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="uuid">99c57de9-bad9-41f7-9b09-9b2e5ac85521</entry>
Oct 26 09:37:50 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:37:50 user nova-compute[74075]:     </system>
Oct 26 09:37:50 user nova-compute[74075]:   </sysinfo>
Oct 26 09:37:50 user nova-compute[74075]:   <os>
Oct 26 09:37:50 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:37:50 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:37:50 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:37:50 user nova-compute[74075]:   </os>
Oct 26 09:37:50 user nova-compute[74075]:   <features>
Oct 26 09:37:50 user nova-compute[74075]:     <acpi/>
Oct 26 09:37:50 user nova-compute[74075]:     <apic/>
Oct 26 09:37:50 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:37:50 user nova-compute[74075]:   </features>
Oct 26 09:37:50 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:37:50 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:37:50 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:37:50 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:37:50 user nova-compute[74075]:   </clock>
Oct 26 09:37:50 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:37:50 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:37:50 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:37:50 user nova-compute[74075]:   </cpu>
Oct 26 09:37:50 user nova-compute[74075]:   <devices>
Oct 26 09:37:50 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:37:50 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:37:50 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk"/>
Oct 26 09:37:50 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:     </disk>
Oct 26 09:37:50 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:37:50 user nova-compute[74075]:       <mac address="fa:16:3e:bf:2e:af"/>
Oct 26 09:37:50 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:37:50 user nova-compute[74075]:       <target dev="tap67ab4aee-33"/>
Oct 26 09:37:50 user nova-compute[74075]:     </interface>
Oct 26 09:37:50 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:37:50 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/console.log" append="off"/>
Oct 26 09:37:50 user nova-compute[74075]:     </serial>
Oct 26 09:37:50 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:37:50 user nova-compute[74075]:     <video>
Oct 26 09:37:50 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:37:50 user nova-compute[74075]:     </video>
Oct 26 09:37:50 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:37:50 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:37:50 user nova-compute[74075]:     </rng>
Oct 26 09:37:50 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:37:50 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:37:50 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:37:50 user nova-compute[74075]:     </memballoon>
Oct 26 09:37:50 user nova-compute[74075]:   </devices>
Oct 26 09:37:50 user nova-compute[74075]: </domain>
Oct 26 09:37:50 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1140593622',display_name='tempest-VolumesActionsTest-instance-1140593622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1140593622',id=25,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2c735fb27274a10a4005325bc5d9e4c',ramdisk_id='',reservation_id='r-zj8mo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450383175',owner_user_name='tempest-VolumesActionsTest-1450383175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:37:49Z,user_data=None,user_id='701652cea9c342469f8b4bed5c3b89c1',uuid=99c57de9-bad9-41f7-9b09-9b2e5ac85521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converting VIF {"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_vif [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1e60636-cfcd-572d-a1f7-665990eaa318', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67ab4aee-33, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67ab4aee-33, col_values=(('qos', UUID('238c31d8-709c-47b2-b56f-3aa3b665d10a')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67ab4aee-33, col_values=(('external_ids', {'iface-id': '67ab4aee-3319-4e9c-b35b-d6ef736c3e14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:2e:af', 'vm-uuid': '99c57de9-bad9-41f7-9b09-9b2e5ac85521'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[37746e25-6ecd-4990-ac4a-4def10c71b99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260]
Oct 26 09:37:50 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260] successful.
Oct 26 09:37:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:50 user nova-compute[74075]: INFO os_vif [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33')
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[228211a0-0836-49ab-a130-13dca9a8b458]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8754a3-571d-491c-9ad5-7c79a22f45c3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:50 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:37:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] No VIF found with MAC fa:16:3e:bf:2e:af, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4041a6cc-9737-482b-9272-2ec11fae3b42]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:37:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance destroyed successfully.
Oct 26 09:37:51 user nova-compute[74075]: INFO nova.compute.manager [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Detaching volume 4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Updated VIF entry in instance network info cache for port 67ab4aee-3319-4e9c-b35b-d6ef736c3e14. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Updating instance_info_cache with network_info: [{"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ea0d5b3-b8e9-4046-b1f7-21ffe43e158e req-e9972885-0c2f-4bd3-a727-e09b33aef721 service nova] Releasing lock "refresh_cache-99c57de9-bad9-41f7-9b09-9b2e5ac85521" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:37:51 user nova-compute[74075]: INFO nova.virt.block_device [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attempting to driver detach volume 4e06e564-21de-4bc9-925c-8c5eee3771b5 from mountpoint /dev/vdb
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Attempting to detach device vdb from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:37:51 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:37:51 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:37:51 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:37:51 user nova-compute[74075]:   <serial>4e06e564-21de-4bc9-925c-8c5eee3771b5</serial>
Oct 26 09:37:51 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:37:51 user nova-compute[74075]: </disk>
Oct 26 09:37:51 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:37:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully detached device vdb from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 from the persistent domain config.
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAjVyBvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== connect_volume: return (2920ms) {'type': 'block', 'scsi_wwn': '23561333031393735', 'path': '/dev/sde'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561333031393735', 'path': '/dev/sde'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.514s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:51 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b1a66-bf6f-4c4e-9a98-dd9f149b58c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:37:52 user nova-compute[74075]: No targets found.
Oct 26 09:37:52 user nova-compute[74075]: iSNS:
Oct 26 09:37:52 user nova-compute[74075]: No targets found.
Oct 26 09:37:52 user nova-compute[74075]: STATIC:
Oct 26 09:37:52 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:37:52 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:52 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:52 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:37:52 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:52 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:52 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037
Oct 26 09:37:52 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:52 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:52 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:37:52 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:52 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:52 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:37:52 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:52 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:52 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:37:52 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:52 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:52 user nova-compute[74075]: FIRMWARE:
Oct 26 09:37:52 user nova-compute[74075]: No targets found.
Oct 26 09:37:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:37:52 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:37:52 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:37:52 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:37:52 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:37:52 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:37:52 user nova-compute[74075]:   <serial>a50e01ef-a276-4f60-9a43-57b9893fa037</serial>
Oct 26 09:37:52 user nova-compute[74075]: </disk>
Oct 26 09:37:52 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9051881-6a5a-4b2b-b148-4ed5030eefd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a42af0-ec6b-460a-91b7-776e00a62bde]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:52 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:37:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[697cce6e-1a85-46b2-9982-0e2921267398]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6674fb6-614c-48ff-902f-f0261c0051b0]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c63513e-46d1-4c58-8653-3690c5a14bb1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341ce87-bcbd-4d65-8e2e-20925a342d76]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[056179e8-01eb-408c-9478-b1fea4f70342]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f69187-ca1d-43dd-bb70-90e28ef0f847]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]
Oct 26 09:37:52 user nova-compute[74075]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.
Oct 26 09:37:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d273ec-4453-4492-9502-3d57fba03c1b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== disconnect_volume: return (862ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-9da9d2f0-c6d7-46cd-b288-84a722ac5963 req-684773c2-1637-42ce-9fb1-2d58ccbab905 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9da9d2f0-c6d7-46cd-b288-84a722ac5963 req-684773c2-1637-42ce-9fb1-2d58ccbab905 service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9da9d2f0-c6d7-46cd-b288-84a722ac5963 req-684773c2-1637-42ce-9fb1-2d58ccbab905 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9da9d2f0-c6d7-46cd-b288-84a722ac5963 req-684773c2-1637-42ce-9fb1-2d58ccbab905 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-9da9d2f0-c6d7-46cd-b288-84a722ac5963 req-684773c2-1637-42ce-9fb1-2d58ccbab905 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:52 user nova-compute[74075]: WARNING nova.compute.manager [req-9da9d2f0-c6d7-46cd-b288-84a722ac5963 req-684773c2-1637-42ce-9fb1-2d58ccbab905 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state active and task_state rebuilding.
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No VIF found with MAC fa:16:3e:28:06:26, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:37:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b683941e-d68d-4c21-930e-3dc3fa4291cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.505s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance destroyed successfully.
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1030772267',display_name='tempest-ServerActionsTestOtherA-server-1616214022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1030772267',id=22,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6XdemNGi/T5Swi6Qm1B3fJox8HXNlq/nDs38Q27usMWgV6OUZP35al+1l4dDaFCJXgrAfYAtM6lOZpqFR1UMG4mroKlQSfHltwkjm/4M85S8xOTkY77/EIN1bmQdtJw==',key_name='tempest-keypair-145721028',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-ei5ackcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=1d69c28a-91cb-47b3-b58d-0391ff8029c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46466255-14, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cdf7643-faa3-4466-a64b-21fa4760d32b) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: INFO os_vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14')
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c66868-3a94-4a6f-ad77-447d0896bf34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:37:53 user nova-compute[74075]: No targets found.
Oct 26 09:37:53 user nova-compute[74075]: iSNS:
Oct 26 09:37:53 user nova-compute[74075]: No targets found.
Oct 26 09:37:53 user nova-compute[74075]: STATIC:
Oct 26 09:37:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:37:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:37:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037
Oct 26 09:37:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:37:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:37:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:37:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:37:53 user nova-compute[74075]: FIRMWARE:
Oct 26 09:37:53 user nova-compute[74075]: No targets found.
Oct 26 09:37:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:37:53 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:37:53 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b851e-a566-4d5a-8553-eea9118fd1dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb78db-c474-44f6-a1ef-d29234a1252f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:37:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:37:53 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:37:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f466433f5b0>, {}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Disconnecting from: [] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== disconnect_volume: return (82ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:37:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Deleting instance files /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6_del
Oct 26 09:37:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Deletion of /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6_del complete
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: INFO nova.virt.block_device [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Booting with volume 4e06e564-21de-4bc9-925c-8c5eee3771b5 at /dev/vdb
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.utils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ae35b-d516-408b-9192-ab2f38ae41c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2429a48-747a-48e4-b297-c4db26fd24f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5b8d7-a2c7-428c-a38e-98931e303d30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db03bf6-e6fc-42ea-a114-3ef6c09e1162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-a515e59b-8d81-4c0c-af54-7f3eeb7cd4a2 req-d47dc620-b8f4-42cc-b1fc-e9b137e7fbb3 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a515e59b-8d81-4c0c-af54-7f3eeb7cd4a2 req-d47dc620-b8f4-42cc-b1fc-e9b137e7fbb3 service nova] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a515e59b-8d81-4c0c-af54-7f3eeb7cd4a2 req-d47dc620-b8f4-42cc-b1fc-e9b137e7fbb3 service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a515e59b-8d81-4c0c-af54-7f3eeb7cd4a2 req-d47dc620-b8f4-42cc-b1fc-e9b137e7fbb3 service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-a515e59b-8d81-4c0c-af54-7f3eeb7cd4a2 req-d47dc620-b8f4-42cc-b1fc-e9b137e7fbb3 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] No waiting events found dispatching network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:53 user nova-compute[74075]: WARNING nova.compute.manager [req-a515e59b-8d81-4c0c-af54-7f3eeb7cd4a2 req-d47dc620-b8f4-42cc-b1fc-e9b137e7fbb3 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received unexpected event network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 for instance with vm_state building and task_state spawning.
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:53 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:37:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d498b7-9818-4c31-afa8-d64de4edf97e]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG os_brick.utils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating existing volume attachment record: 78a929be-d67f-4da1-acec-e56344a4033f {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:54 user nova-compute[74075]: WARNING nova.compute.manager [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state resized and task_state resize_reverting.
Oct 26 09:37:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:54 user nova-compute[74075]: WARNING nova.compute.manager [req-3f10b4f5-40ce-452e-94ca-01a3487dd153 req-8e14480b-ec6e-42b4-bfea-db91b708868e service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state resized and task_state resize_reverting.
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:54 user nova-compute[74075]: INFO nova.compute.manager [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Detaching volume 20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:37:54 user nova-compute[74075]: INFO nova.virt.block_device [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Attempting to driver detach volume 20d11606-8073-43a6-b23c-dcf287e9033d from mountpoint /dev/vdb
Oct 26 09:37:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Attempting to detach device vdb from instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:37:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:37:55 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:37:55 user nova-compute[74075]:   <source dev="/dev/sdg"/>
Oct 26 09:37:55 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:37:55 user nova-compute[74075]:   <serial>20d11606-8073-43a6-b23c-dcf287e9033d</serial>
Oct 26 09:37:55 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:37:55 user nova-compute[74075]: </disk>
Oct 26 09:37:55 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:37:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully detached device vdb from instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c from the persistent domain config.
Oct 26 09:37:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:37:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:37:55 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:37:55 user nova-compute[74075]:   <source dev="/dev/sdg"/>
Oct 26 09:37:55 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:37:55 user nova-compute[74075]:   <serial>20d11606-8073-43a6-b23c-dcf287e9033d</serial>
Oct 26 09:37:55 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:37:55 user nova-compute[74075]: </disk>
Oct 26 09:37:55 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:37:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-e63680b8-833e-4efd-a97d-a4d13981e08a req-d1889ebc-b054-4b72-879d-6e3dd1735224 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e63680b8-833e-4efd-a97d-a4d13981e08a req-d1889ebc-b054-4b72-879d-6e3dd1735224 service nova] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e63680b8-833e-4efd-a97d-a4d13981e08a req-d1889ebc-b054-4b72-879d-6e3dd1735224 service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e63680b8-833e-4efd-a97d-a4d13981e08a req-d1889ebc-b054-4b72-879d-6e3dd1735224 service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-e63680b8-833e-4efd-a97d-a4d13981e08a req-d1889ebc-b054-4b72-879d-6e3dd1735224 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] No waiting events found dispatching network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:37:56 user nova-compute[74075]: WARNING nova.compute.manager [req-e63680b8-833e-4efd-a97d-a4d13981e08a req-d1889ebc-b054-4b72-879d-6e3dd1735224 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received unexpected event network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 for instance with vm_state building and task_state spawning.
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:37:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Instance spawned successfully.
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:37:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance running successfully.
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] finish_revert_migration finished successfully. {{(pid=74075) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:37:56 user nova-compute[74075]: INFO nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Took 7.82 seconds to spawn the instance on the hypervisor.
Oct 26 09:37:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:37:56 user nova-compute[74075]: INFO nova.compute.manager [None req-2922206c-b06e-4fd6-90de-75f0348d7707 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance to original state: 'active'
Oct 26 09:37:56 user nova-compute[74075]: INFO nova.compute.manager [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Took 8.65 seconds to build instance.
Oct 26 09:37:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7fae2ea0-eb74-450f-8db9-11231ee4dabb tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.758s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG nova.objects.instance [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:37:59 user nova-compute[74075]: INFO nova.compute.manager [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attaching volume 8f7e6bfd-564d-4434-922a-1c1e3c9dac7c to /dev/vdc
Oct 26 09:37:59 user nova-compute[74075]: DEBUG os_brick.utils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b7352f-96af-40bc-860a-72a9f60cdf16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e7c33-a7cb-46d2-820b-8e7ae6950218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d664227a-f973-49f4-ab32-a0f1a5ba560c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d1035-d572-4d7e-bdd6-3bfb6b8845f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:37:59 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:37:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9d4ddc-0134-495e-abee-6f57fc01eaab]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG os_brick.utils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:37:59 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updating existing volume attachment record: 3446356e-568a-476a-a354-41fcc9f0cebd {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:38:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:38:06 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:38:06 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.31938934326172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 26902518-83b8-4811-a1bb-fc70a8786fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 99c57de9-bad9-41f7-9b09-9b2e5ac85521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:38:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:38:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c is timed out.
Oct 26 09:38:15 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully detached device vdb from instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c from the live domain config.
Oct 26 09:38:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EecnsMpl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:38:15 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[593e43c3-4a83-4074-b446-b59284c3fc9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:38:15 user nova-compute[74075]: No targets found.
Oct 26 09:38:15 user nova-compute[74075]: iSNS:
Oct 26 09:38:15 user nova-compute[74075]: No targets found.
Oct 26 09:38:15 user nova-compute[74075]: STATIC:
Oct 26 09:38:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d
Oct 26 09:38:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:38:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037
Oct 26 09:38:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:38:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:15 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:38:15 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:15 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:15 user nova-compute[74075]: FIRMWARE:
Oct 26 09:38:15 user nova-compute[74075]: No targets found.
Oct 26 09:38:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:38:15 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:38:15 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c004d47-5a0b-4fcd-87ad-c124f831a4df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a106cb6-7db4-4e8a-a4ca-4a3c480442fc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:15 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c281ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d'): ({'sdg'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Removing single pathed devices sdg {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a6d54-199d-4943-aa83-09adcf075a3d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6f7e65-2ab5-406e-8380-575c8ec4a633]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flushing IO for device /dev/sdg {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b819a26-6a75-4086-9a1e-db901db2dcee]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58355f5-49ac-41a2-9450-9f04389c1d36]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.143s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a971b-02fe-425e-954f-76c5f9035dc7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb0d790-3536-42a9-be86-080974c9c4e8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260]
Oct 26 09:38:15 user nova-compute[74075]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d, portal: 172.16.0.220,3260] successful.
Oct 26 09:38:15 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d11606-8073-43a6-b23c-dcf287e9033d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f636744-1ad5-4703-a5d2-b8169f76cd4a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== disconnect_volume: return (437ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:38:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:38:16 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Creating image(s)
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.233s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk 1073741824" returned: 0 in 0.050s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid fccf2eec-a34b-47bc-bbc4-0369faf87a9c {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d66c1da1-966b-44a0-aa6c-fd7b7e958fa6 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.016s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Cannot resize image /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Ensure instance console log exists: /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Start _get_guest_xml network_info=[{"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '78a929be-d67f-4da1-acec-e56344a4033f', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d69c28a-91cb-47b3-b58d-0391ff8029c6', 'attached_at': '', 'detached_at': '', 'volume_id': '4e06e564-21de-4bc9-925c-8c5eee3771b5', 'serial': '4e06e564-21de-4bc9-925c-8c5eee3771b5'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:38:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 09:38:17 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:38:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:38:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:38:17 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a622a83-c6c4-491b-9de1-b98735a6d415]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:38:17 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e5bf8-76a4-42e1-9bcb-61da01b1b1ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5] added
Oct 26 09:38:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2c1bde-10da-4a65-9a1c-c2acc60358bc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74b2e30-3171-4726-93c9-74bd4f5670cc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnLOimAv {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnLOimAv" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c395d0-6c65-49a7-83ea-1e0a0ebba287]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnLOimAv'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd96e8-f918-4061-8822-548d6349e38f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[779755c0-d669-4595-8030-9e295ceff813]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989b973-ce9f-45d4-b2b9-de4331ae2205]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]
Oct 26 09:38:17 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.
Oct 26 09:38:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3cd637-4744-4308-b1aa-12e69505f582]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e25449-e3d1-4dbb-ba29-d45bfdad2b9a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d5d445-bbe7-450b-992e-99e08c9f531d]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:38:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23931383030393530', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383030393530', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1030772267',display_name='tempest-ServerActionsTestOtherA-server-1616214022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1030772267',id=22,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6XdemNGi/T5Swi6Qm1B3fJox8HXNlq/nDs38Q27usMWgV6OUZP35al+1l4dDaFCJXgrAfYAtM6lOZpqFR1UMG4mroKlQSfHltwkjm/4M85S8xOTkY77/EIN1bmQdtJw==',key_name='tempest-keypair-145721028',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-ei5ackcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=1d69c28a-91cb-47b3-b58d-0391ff8029c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:38:18 user nova-compute[74075]:   <uuid>1d69c28a-91cb-47b3-b58d-0391ff8029c6</uuid>
Oct 26 09:38:18 user nova-compute[74075]:   <name>instance-00000016</name>
Oct 26 09:38:18 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:38:18 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:38:18 user nova-compute[74075]:   <metadata>
Oct 26 09:38:18 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:38:18 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:38:18 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherA-server-1616214022</nova:name>
Oct 26 09:38:18 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:38:17</nova:creationTime>
Oct 26 09:38:18 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:38:18 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:38:18 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:38:18 user nova-compute[74075]:       <nova:owner>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:user uuid="729f5d24fc714c65b3c1a811e5cdf271">tempest-ServerActionsTestOtherA-546437878-project-member</nova:user>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:project uuid="7a627b8e169d4a97b075f16e150d972f">tempest-ServerActionsTestOtherA-546437878</nova:project>
Oct 26 09:38:18 user nova-compute[74075]:       </nova:owner>
Oct 26 09:38:18 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:38:18 user nova-compute[74075]:       <nova:ports>
Oct 26 09:38:18 user nova-compute[74075]:         <nova:port uuid="46466255-14c7-44ca-a9f2-ba113a2f6c7b">
Oct 26 09:38:18 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:38:18 user nova-compute[74075]:         </nova:port>
Oct 26 09:38:18 user nova-compute[74075]:       </nova:ports>
Oct 26 09:38:18 user nova-compute[74075]:     </nova:instance>
Oct 26 09:38:18 user nova-compute[74075]:   </metadata>
Oct 26 09:38:18 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:38:18 user nova-compute[74075]:     <system>
Oct 26 09:38:18 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:38:18 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:38:18 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:38:18 user nova-compute[74075]:       <entry name="serial">1d69c28a-91cb-47b3-b58d-0391ff8029c6</entry>
Oct 26 09:38:18 user nova-compute[74075]:       <entry name="uuid">1d69c28a-91cb-47b3-b58d-0391ff8029c6</entry>
Oct 26 09:38:18 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:38:18 user nova-compute[74075]:     </system>
Oct 26 09:38:18 user nova-compute[74075]:   </sysinfo>
Oct 26 09:38:18 user nova-compute[74075]:   <os>
Oct 26 09:38:18 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:38:18 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:38:18 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:38:18 user nova-compute[74075]:   </os>
Oct 26 09:38:18 user nova-compute[74075]:   <features>
Oct 26 09:38:18 user nova-compute[74075]:     <acpi/>
Oct 26 09:38:18 user nova-compute[74075]:     <apic/>
Oct 26 09:38:18 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:38:18 user nova-compute[74075]:   </features>
Oct 26 09:38:18 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:38:18 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:38:18 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:38:18 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:38:18 user nova-compute[74075]:   </clock>
Oct 26 09:38:18 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:38:18 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:38:18 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:38:18 user nova-compute[74075]:   </cpu>
Oct 26 09:38:18 user nova-compute[74075]:   <devices>
Oct 26 09:38:18 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:38:18 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:38:18 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk"/>
Oct 26 09:38:18 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:38:18 user nova-compute[74075]:     </disk>
Oct 26 09:38:18 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:38:18 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:18 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:38:18 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:38:18 user nova-compute[74075]:       <serial>4e06e564-21de-4bc9-925c-8c5eee3771b5</serial>
Oct 26 09:38:18 user nova-compute[74075]:     </disk>
Oct 26 09:38:18 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:38:18 user nova-compute[74075]:       <mac address="fa:16:3e:00:07:6b"/>
Oct 26 09:38:18 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:38:18 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:38:18 user nova-compute[74075]:       <target dev="tap46466255-14"/>
Oct 26 09:38:18 user nova-compute[74075]:     </interface>
Oct 26 09:38:18 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:38:18 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/console.log" append="off"/>
Oct 26 09:38:18 user nova-compute[74075]:     </serial>
Oct 26 09:38:18 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:38:18 user nova-compute[74075]:     <video>
Oct 26 09:38:18 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:38:18 user nova-compute[74075]:     </video>
Oct 26 09:38:18 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:38:18 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:38:18 user nova-compute[74075]:     </rng>
Oct 26 09:38:18 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:38:18 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:38:18 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:38:18 user nova-compute[74075]:     </memballoon>
Oct 26 09:38:18 user nova-compute[74075]:   </devices>
Oct 26 09:38:18 user nova-compute[74075]: </domain>
Oct 26 09:38:18 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1030772267',display_name='tempest-ServerActionsTestOtherA-server-1616214022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1030772267',id=22,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6XdemNGi/T5Swi6Qm1B3fJox8HXNlq/nDs38Q27usMWgV6OUZP35al+1l4dDaFCJXgrAfYAtM6lOZpqFR1UMG4mroKlQSfHltwkjm/4M85S8xOTkY77/EIN1bmQdtJw==',key_name='tempest-keypair-145721028',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-ei5ackcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=1d69c28a-91cb-47b3-b58d-0391ff8029c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG os_vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1e78d5-7b09-586a-bb99-3ae7deed493b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46466255-14, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46466255-14, col_values=(('qos', UUID('98e2782f-af9a-43c7-b21e-11e0ed0287cb')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46466255-14, col_values=(('external_ids', {'iface-id': '46466255-14c7-44ca-a9f2-ba113a2f6c7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:07:6b', 'vm-uuid': '1d69c28a-91cb-47b3-b58d-0391ff8029c6'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:18 user nova-compute[74075]: INFO os_vif [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14')
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:38:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No VIF found with MAC fa:16:3e:00:07:6b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hiAbDFNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:38:19 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:38:19 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:38:19 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298ccbf-34f9-48b3-9a7b-2b993ba9a09a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:38:19 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd41a7-cc39-4d5d-8434-85b4ff711ffd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c] added
Oct 26 09:38:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05f50d-cb20-489c-98c4-b81dd5473df8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6d1ab3-76a5-4ba0-936a-f640cd97cea9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hiAbDFNv {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hiAbDFNv" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f8355c-0a76-4307-9a06-f4be74bde65a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hiAbDFNv'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e277a58d-bfce-4779-b1e6-9670ab9087d3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af9907-eebe-409f-9128-16725c8059b5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-12ec3dcc-57b5-4e7e-931d-f8a61a45a9e0 req-9ab52b54-cefb-484c-8085-01b21e022830 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12ec3dcc-57b5-4e7e-931d-f8a61a45a9e0 req-9ab52b54-cefb-484c-8085-01b21e022830 service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12ec3dcc-57b5-4e7e-931d-f8a61a45a9e0 req-9ab52b54-cefb-484c-8085-01b21e022830 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-12ec3dcc-57b5-4e7e-931d-f8a61a45a9e0 req-9ab52b54-cefb-484c-8085-01b21e022830 service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-12ec3dcc-57b5-4e7e-931d-f8a61a45a9e0 req-9ab52b54-cefb-484c-8085-01b21e022830 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:38:20 user nova-compute[74075]: WARNING nova.compute.manager [req-12ec3dcc-57b5-4e7e-931d-f8a61a45a9e0 req-9ab52b54-cefb-484c-8085-01b21e022830 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state active and task_state rebuild_spawning.
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f75feca-f047-4c2c-8132-0e613c50c3ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260]
Oct 26 09:38:20 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260] successful.
Oct 26 09:38:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea497e9f-7266-4145-86ab-07b40d8c921a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f84125-5967-4446-b6f6-68a11e42296a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:38:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:20 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:38:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[181670bf-a556-4eab-ae72-da72ea9ed827]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:38:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hiAbDFNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '23438393062623862', 'path': '/dev/sdg'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438393062623862', 'path': '/dev/sdg'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:38:21 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:21 user nova-compute[74075]:   <source dev="/dev/sdg"/>
Oct 26 09:38:21 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:38:21 user nova-compute[74075]:   <serial>8f7e6bfd-564d-4434-922a-1c1e3c9dac7c</serial>
Oct 26 09:38:21 user nova-compute[74075]: </disk>
Oct 26 09:38:21 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] No VIF found with MAC fa:16:3e:28:06:26, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9caf4d0d-4ff3-4f82-acd4-1d8e4157d75c tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.570s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-64ab0f44-be8e-40da-8696-f07d82b763dc req-43dc3635-a081-4f3d-8a88-8f8a680d5a9d service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-64ab0f44-be8e-40da-8696-f07d82b763dc req-43dc3635-a081-4f3d-8a88-8f8a680d5a9d service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-64ab0f44-be8e-40da-8696-f07d82b763dc req-43dc3635-a081-4f3d-8a88-8f8a680d5a9d service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-64ab0f44-be8e-40da-8696-f07d82b763dc req-43dc3635-a081-4f3d-8a88-8f8a680d5a9d service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.compute.manager [req-64ab0f44-be8e-40da-8696-f07d82b763dc req-43dc3635-a081-4f3d-8a88-8f8a680d5a9d service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:38:22 user nova-compute[74075]: WARNING nova.compute.manager [req-64ab0f44-be8e-40da-8696-f07d82b763dc req-43dc3635-a081-4f3d-8a88-8f8a680d5a9d service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state active and task_state rebuild_spawning.
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:38:22 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance spawned successfully.
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74075) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 09:38:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f3be0d47-6370-49b0-b1c2-f709773169ea tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:23 user nova-compute[74075]: INFO nova.compute.manager [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Detaching volume a50e01ef-a276-4f60-9a43-57b9893fa037
Oct 26 09:38:23 user nova-compute[74075]: INFO nova.virt.block_device [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attempting to driver detach volume a50e01ef-a276-4f60-9a43-57b9893fa037 from mountpoint /dev/vdb
Oct 26 09:38:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Attempting to detach device vdb from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:38:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:38:23 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:23 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:38:23 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:38:23 user nova-compute[74075]:   <serial>a50e01ef-a276-4f60-9a43-57b9893fa037</serial>
Oct 26 09:38:23 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:38:23 user nova-compute[74075]: </disk>
Oct 26 09:38:23 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:38:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully detached device vdb from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the persistent domain config.
Oct 26 09:38:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:38:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:38:23 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:23 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:38:23 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:38:23 user nova-compute[74075]:   <serial>a50e01ef-a276-4f60-9a43-57b9893fa037</serial>
Oct 26 09:38:23 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:38:23 user nova-compute[74075]: </disk>
Oct 26 09:38:23 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:38:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:38:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26902518-83b8-4811-a1bb-fc70a8786fbd is timed out.
Oct 26 09:38:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully detached device vdb from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the live domain config.
Oct 26 09:38:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAjVyBvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:38:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fab634-18da-4c5d-825f-ca135bde70c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:38:44 user nova-compute[74075]: No targets found.
Oct 26 09:38:44 user nova-compute[74075]: iSNS:
Oct 26 09:38:44 user nova-compute[74075]: No targets found.
Oct 26 09:38:44 user nova-compute[74075]: STATIC:
Oct 26 09:38:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:38:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037
Oct 26 09:38:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:38:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:38:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c
Oct 26 09:38:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:38:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:38:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:38:44 user nova-compute[74075]: FIRMWARE:
Oct 26 09:38:44 user nova-compute[74075]: No targets found.
Oct 26 09:38:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:38:44 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:38:44 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d7cfd2-7869-48b3-a31e-6c27977fc1f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3990f2e8-2066-4b12-b316-8041cffbc753]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:38:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:38:44 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:38:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1611b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037'): ({'sde'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Removing single pathed devices sde {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d60c227-11e5-4717-83f2-7f4b0365c7db]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5a738f-5f2c-4a3e-a95b-4e8b7313b212]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flushing IO for device /dev/sde {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[358934bf-9582-4216-85a3-92460262dac7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9161393f-206b-49e0-9b5c-8e8d2fca0a69]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08d17f0-9557-48ea-9379-aeccc8ed365c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5dcc5-9de6-49e0-8d70-77bc4533b298]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260]
Oct 26 09:38:44 user nova-compute[74075]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037, portal: 172.16.0.220,3260] successful.
Oct 26 09:38:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a50e01ef-a276-4f60-9a43-57b9893fa037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd93a43-b1d0-493d-9334-f3a450c5a40f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== disconnect_volume: return (345ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:38:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:45 user nova-compute[74075]: INFO nova.compute.manager [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Terminating instance
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-9c92250f-f320-4d96-a743-6f8530fae859 req-e5cfbf0e-6f0b-4c4e-b0d1-7c50ff0bdc52 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-vif-unplugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9c92250f-f320-4d96-a743-6f8530fae859 req-e5cfbf0e-6f0b-4c4e-b0d1-7c50ff0bdc52 service nova] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9c92250f-f320-4d96-a743-6f8530fae859 req-e5cfbf0e-6f0b-4c4e-b0d1-7c50ff0bdc52 service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9c92250f-f320-4d96-a743-6f8530fae859 req-e5cfbf0e-6f0b-4c4e-b0d1-7c50ff0bdc52 service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-9c92250f-f320-4d96-a743-6f8530fae859 req-e5cfbf0e-6f0b-4c4e-b0d1-7c50ff0bdc52 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] No waiting events found dispatching network-vif-unplugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-9c92250f-f320-4d96-a743-6f8530fae859 req-e5cfbf0e-6f0b-4c4e-b0d1-7c50ff0bdc52 service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-vif-unplugged-679c010d-71ce-4729-89bf-c3e242b330a6 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Instance destroyed successfully.
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'resources' on Instance uuid fccf2eec-a34b-47bc-bbc4-0369faf87a9c {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1750273276',display_name='tempest-AttachVolumeNegativeTest-server-1750273276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1750273276',id=18,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjJHWn+iHEqM+8pI6FdijZwEAGjl+E2GLMRYQSy6dMB0121ayiJWj7UbKmHTB8jAi5jLwGaMtg2wJWrEE973JAjtsCYzQ0q6b9rwCVkx8+WNmEbm7Chwo8JytTdxErfWw==',key_name='tempest-keypair-1709392585',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:33:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-busfm2o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=fccf2eec-a34b-47bc-bbc4-0369faf87a9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "679c010d-71ce-4729-89bf-c3e242b330a6", "address": "fa:16:3e:a8:65:9c", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c010d-71", "ovs_interfaceid": "679c010d-71ce-4729-89bf-c3e242b330a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG os_vif [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap679c010d-71, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94d8083d-6a51-4c55-bb76-d3834b0ef4b4) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:38:45 user nova-compute[74075]: INFO os_vif [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:65:9c,bridge_name='br-int',has_traffic_filtering=True,id=679c010d-71ce-4729-89bf-c3e242b330a6,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c010d-71')
Oct 26 09:38:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Deleting instance files /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c_del
Oct 26 09:38:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Deletion of /opt/stack/data/nova/instances/fccf2eec-a34b-47bc-bbc4-0369faf87a9c_del complete
Oct 26 09:38:46 user nova-compute[74075]: INFO nova.compute.manager [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 09:38:46 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:38:46 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:38:46 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:38:46 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:38:46 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Took 0.78 seconds to deallocate network for instance.
Oct 26 09:38:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:47 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Deleted allocations for instance fccf2eec-a34b-47bc-bbc4-0369faf87a9c
Oct 26 09:38:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3805da53-275d-4eb7-81cc-3bfe757de206 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] Acquiring lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] Lock "fccf2eec-a34b-47bc-bbc4-0369faf87a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] No waiting events found dispatching network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:38:47 user nova-compute[74075]: WARNING nova.compute.manager [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received unexpected event network-vif-plugged-679c010d-71ce-4729-89bf-c3e242b330a6 for instance with vm_state deleted and task_state None.
Oct 26 09:38:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-9600bf10-9631-43d0-8804-ac72bf3c12f5 req-905ba62b-365f-4910-96e0-54f7a91cd1ec service nova] [instance: fccf2eec-a34b-47bc-bbc4-0369faf87a9c] Received event network-vif-deleted-679c010d-71ce-4729-89bf-c3e242b330a6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing instance network info cache due to event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:38:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:38:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:38:50 user nova-compute[74075]: DEBUG nova.network.neutron [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:38:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updated VIF entry in instance network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f0d585cc-6eeb-469d-a302-31bdbf083837 req-a0562603-88d7-4f34-8ddd-a6963523d8a1 service nova] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:51 user nova-compute[74075]: INFO nova.compute.manager [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Detaching volume 81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:38:51 user nova-compute[74075]: INFO nova.virt.block_device [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Attempting to driver detach volume 81752223-8cd9-4a38-a8e3-a29b36b64526 from mountpoint /dev/vdb
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Attempting to detach device vdb from instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:38:51 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:51 user nova-compute[74075]:   <source dev="/dev/sdf"/>
Oct 26 09:38:51 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:38:51 user nova-compute[74075]:   <serial>81752223-8cd9-4a38-a8e3-a29b36b64526</serial>
Oct 26 09:38:51 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:38:51 user nova-compute[74075]: </disk>
Oct 26 09:38:51 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:38:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully detached device vdb from instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 from the persistent domain config.
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:38:51 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:51 user nova-compute[74075]:   <source dev="/dev/sdf"/>
Oct 26 09:38:51 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:38:51 user nova-compute[74075]:   <serial>81752223-8cd9-4a38-a8e3-a29b36b64526</serial>
Oct 26 09:38:51 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:38:51 user nova-compute[74075]: </disk>
Oct 26 09:38:51 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e1a62cd0-f61e-45c7-93e9-9d3f3bb4239e tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.145s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing instance network info cache due to event network-changed-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] Acquiring lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] Acquired lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:38:52 user nova-compute[74075]: DEBUG nova.network.neutron [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Refreshing network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG nova.network.neutron [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updated VIF entry in instance network info cache for port f1bec6c3-c88d-4e3e-bcea-b3f7eb728867. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG nova.network.neutron [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [{"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b67ec6ab-de87-4b5e-a7a6-0b7b8cb392ce req-9f1aadd4-5c66-4b48-a44c-03266c58d3d5 service nova] Releasing lock "refresh_cache-0ed7d017-b761-4efe-9cc6-995fac04dd58" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:38:53 user nova-compute[74075]: INFO nova.compute.manager [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Detaching volume 8f7e6bfd-564d-4434-922a-1c1e3c9dac7c
Oct 26 09:38:53 user nova-compute[74075]: INFO nova.virt.block_device [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Attempting to driver detach volume 8f7e6bfd-564d-4434-922a-1c1e3c9dac7c from mountpoint /dev/vdc
Oct 26 09:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Attempting to detach device vdc from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:38:53 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:53 user nova-compute[74075]:   <source dev="/dev/sdg"/>
Oct 26 09:38:53 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:38:53 user nova-compute[74075]:   <serial>8f7e6bfd-564d-4434-922a-1c1e3c9dac7c</serial>
Oct 26 09:38:53 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 09:38:53 user nova-compute[74075]: </disk>
Oct 26 09:38:53 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:38:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully detached device vdc from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the persistent domain config.
Oct 26 09:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:38:53 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:38:53 user nova-compute[74075]:   <source dev="/dev/sdg"/>
Oct 26 09:38:53 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:38:53 user nova-compute[74075]:   <serial>8f7e6bfd-564d-4434-922a-1c1e3c9dac7c</serial>
Oct 26 09:38:53 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 09:38:53 user nova-compute[74075]: </disk>
Oct 26 09:38:53 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:38:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:38:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:38:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updating instance_info_cache with network_info: [{"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-dd7a3ed2-b161-4950-bbcc-8de9c33e2275" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:39:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:39:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:39:06 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:39:06 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7465MB free_disk=25.280208587646484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 26902518-83b8-4811-a1bb-fc70a8786fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 99c57de9-bad9-41f7-9b09-9b2e5ac85521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:39:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:39:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:11 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 is timed out.
Oct 26 09:39:11 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully detached device vdb from instance 0ed7d017-b761-4efe-9cc6-995fac04dd58 from the live domain config.
Oct 26 09:39:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:39:11 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrHufNsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:39:11 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:39:11 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:39:11 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:39:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c03ee-cf63-4a43-8d6a-eca6b9d57449]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:39:12 user nova-compute[74075]: No targets found.
Oct 26 09:39:12 user nova-compute[74075]: iSNS:
Oct 26 09:39:12 user nova-compute[74075]: No targets found.
Oct 26 09:39:12 user nova-compute[74075]: STATIC:
Oct 26 09:39:12 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:39:12 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:12 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:12 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526
Oct 26 09:39:12 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:12 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:12 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:39:12 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:12 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:12 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c
Oct 26 09:39:12 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:12 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:12 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:39:12 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:12 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:12 user nova-compute[74075]: FIRMWARE:
Oct 26 09:39:12 user nova-compute[74075]: No targets found.
Oct 26 09:39:12 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:39:12 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:39:12 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b818c2-9658-43c7-a60d-bd19abe69f1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda24798-6aeb-4627-8aba-643af99e4f8e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:39:12 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:39:12 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:39:12 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526'): ({'sdf'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Removing single pathed devices sdf {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf6b26-c8de-4bf2-b81b-312eea378375]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[934eb2e7-f969-4277-b000-5354090eb5fa]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Flushing IO for device /dev/sdf {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[70300fd9-6c1a-4d40-9d06-d742376c05c0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[774b1dea-119f-4818-8730-00a6482a61e5]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a144dc26-4e07-405f-8471-f0e5fa8a3784]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b67ded-e995-40ef-a51d-7442f1e47f15]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260]
Oct 26 09:39:12 user nova-compute[74075]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526, portal: 172.16.0.220,3260] successful.
Oct 26 09:39:12 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81752223-8cd9-4a38-a8e3-a29b36b64526 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b912bd-019b-4040-9684-dbf95eead743]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] <== disconnect_volume: return (318ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:39:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:39:14 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 26902518-83b8-4811-a1bb-fc70a8786fbd is timed out.
Oct 26 09:39:14 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully detached device vdc from instance 26902518-83b8-4811-a1bb-fc70a8786fbd from the live domain config.
Oct 26 09:39:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hiAbDFNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:39:14 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75cc5fd-f3ce-47be-a824-daca545238ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:39:14 user nova-compute[74075]: No targets found.
Oct 26 09:39:14 user nova-compute[74075]: iSNS:
Oct 26 09:39:14 user nova-compute[74075]: No targets found.
Oct 26 09:39:14 user nova-compute[74075]: STATIC:
Oct 26 09:39:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:39:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:39:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c
Oct 26 09:39:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:14 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:39:14 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:39:14 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:39:14 user nova-compute[74075]: FIRMWARE:
Oct 26 09:39:14 user nova-compute[74075]: No targets found.
Oct 26 09:39:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:39:14 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:39:14 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea959ece-763e-4ab0-a7ce-b767c1dfbeab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4aafd-08ee-4850-8a89-836b6f2f4f3c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:39:14 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:39:14 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:39:14 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:39:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:39:14 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:39:14 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:39:14 user nova-compute[74075]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c (non-flash)
Oct 26 09:39:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c16d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c'): ({'sdg'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Removing single pathed devices sdg {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c246194-b432-466e-b35e-737903884ab3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c02f28b-3400-4e57-b424-69ad1bb8c8d3]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Flushing IO for device /dev/sdg {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[05364904-ab5d-48e5-8b47-2f33f40c7914]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0cce38-5e50-42e5-a727-bd083304ff36]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5110a2-5e14-499b-b06c-947136511687]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[445fc126-ea90-40c8-97f2-7deed897c58e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260]
Oct 26 09:39:14 user nova-compute[74075]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c, portal: 172.16.0.220,3260] successful.
Oct 26 09:39:14 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7e6bfd-564d-4434-922a-1c1e3c9dac7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff229232-e7ae-4405-9f64-8755d34e2552]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] <== disconnect_volume: return (298ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:39:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:39:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'flavor' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-272a1686-da73-47d5-b337-dc76b38257ce tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.009s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'flavor' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-072da5de-48b5-4103-94a9-479d4ed730f6 tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.147s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:23 user nova-compute[74075]: INFO nova.compute.manager [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Terminating instance
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-c97f53fa-8ae4-4e73-9fbe-572a931e0467 req-755c52a4-2407-4dcb-966b-33b6107453fa service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-vif-unplugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c97f53fa-8ae4-4e73-9fbe-572a931e0467 req-755c52a4-2407-4dcb-966b-33b6107453fa service nova] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c97f53fa-8ae4-4e73-9fbe-572a931e0467 req-755c52a4-2407-4dcb-966b-33b6107453fa service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c97f53fa-8ae4-4e73-9fbe-572a931e0467 req-755c52a4-2407-4dcb-966b-33b6107453fa service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-c97f53fa-8ae4-4e73-9fbe-572a931e0467 req-755c52a4-2407-4dcb-966b-33b6107453fa service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] No waiting events found dispatching network-vif-unplugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-c97f53fa-8ae4-4e73-9fbe-572a931e0467 req-755c52a4-2407-4dcb-966b-33b6107453fa service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-vif-unplugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Instance destroyed successfully.
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lazy-loading 'resources' on Instance uuid 26902518-83b8-4811-a1bb-fc70a8786fbd {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2033539692',display_name='tempest-AttachVolumeTestJSON-server-2033539692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2033539692',id=24,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7VqE5t8JiVih8sJq1tYFKnN/My3nIEwOyxMYcCgHUsJZDQGmoRj+vqQbkV4dRjJ+uvCzmMKrWgqc4YTpS6wUun+ALwJEtfpWWJIpgTlt1Bi1qhVEhR4h+0ou0g01quhw==',key_name='tempest-keypair-949214122',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c09f49b38ff4e4f96fa233d1c8e33f4',ramdisk_id='',reservation_id='r-02quyn1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1598575575',owner_user_name='tempest-AttachVolumeTestJSON-1598575575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454822c8719441388cd38cd86b736b3c',uuid=26902518-83b8-4811-a1bb-fc70a8786fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converting VIF {"id": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "address": "fa:16:3e:28:06:26", "network": {"id": "fa496d20-0b07-4b60-ab74-3721a85f1d61", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-160095037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c09f49b38ff4e4f96fa233d1c8e33f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0287d2e8-16", "ovs_interfaceid": "0287d2e8-161d-4c34-94c7-22e3cbe0ebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG os_vif [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0287d2e8-16, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26918661-e4fd-42ac-8bc4-f83cef587a21) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:39:23 user nova-compute[74075]: INFO nova.compute.claims [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Claim successful on node user
Oct 26 09:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:23 user nova-compute[74075]: INFO os_vif [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:06:26,bridge_name='br-int',has_traffic_filtering=True,id=0287d2e8-161d-4c34-94c7-22e3cbe0ebc4,network=Network(fa496d20-0b07-4b60-ab74-3721a85f1d61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0287d2e8-16')
Oct 26 09:39:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Deleting instance files /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd_del
Oct 26 09:39:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Deletion of /opt/stack/data/nova/instances/26902518-83b8-4811-a1bb-fc70a8786fbd_del complete
Oct 26 09:39:23 user nova-compute[74075]: INFO nova.compute.manager [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 09:39:23 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:39:23 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:39:24 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.policy [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05e6ea9a6e248e892fb237a31d4b1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf8f091fdd04a9c8e5b14632402efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:39:24 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Creating image(s)
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "/opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.233s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:24 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Took 0.89 seconds to deallocate network for instance.
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.201s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Successfully created port: f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] Acquiring lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] No waiting events found dispatching network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:25 user nova-compute[74075]: WARNING nova.compute.manager [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received unexpected event network-vif-plugged-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 for instance with vm_state deleted and task_state None.
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-27c3ed33-456a-4eca-8939-00e8a09136c5 req-6b6753c6-8617-4b47-817f-964d02fc78fc service nova] [instance: 26902518-83b8-4811-a1bb-fc70a8786fbd] Received event network-vif-deleted-0287d2e8-161d-4c34-94c7-22e3cbe0ebc4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Cannot resize image /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Ensure instance console log exists: /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:25 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Deleted allocations for instance 26902518-83b8-4811-a1bb-fc70a8786fbd
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c3680274-9cee-449d-b3f7-cfb6b48bf1cc tempest-AttachVolumeTestJSON-1598575575 tempest-AttachVolumeTestJSON-1598575575-project-member] Lock "26902518-83b8-4811-a1bb-fc70a8786fbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.546s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Successfully updated port: f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:39:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-changed-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Refreshing instance network info cache due to event network-changed-f496eb03-2f60-485a-b706-06afc29b9a78. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] Acquiring lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Updating instance_info_cache with network_info: [{"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Instance network_info: |[{"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] Acquired lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Refreshing network info cache for port f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Start _get_guest_xml network_info=[{"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:39:26 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:39:26 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834608990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834608990',id=26,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-mrg5hmq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:39:24Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=668b12c1-9874-472a-88ca-f6671d6a4ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'pci_devices' on Instance uuid 668b12c1-9874-472a-88ca-f6671d6a4ba6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:39:26 user nova-compute[74075]:   <uuid>668b12c1-9874-472a-88ca-f6671d6a4ba6</uuid>
Oct 26 09:39:26 user nova-compute[74075]:   <name>instance-0000001a</name>
Oct 26 09:39:26 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:39:26 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:39:26 user nova-compute[74075]:   <metadata>
Oct 26 09:39:26 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:39:26 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:39:26 user nova-compute[74075]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1834608990</nova:name>
Oct 26 09:39:26 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:39:26</nova:creationTime>
Oct 26 09:39:26 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:39:26 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:39:26 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:39:26 user nova-compute[74075]:       <nova:owner>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:user uuid="f05e6ea9a6e248e892fb237a31d4b1a1">tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member</nova:user>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:project uuid="abf8f091fdd04a9c8e5b14632402efae">tempest-ServerBootFromVolumeStableRescueTest-1733320520</nova:project>
Oct 26 09:39:26 user nova-compute[74075]:       </nova:owner>
Oct 26 09:39:26 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:39:26 user nova-compute[74075]:       <nova:ports>
Oct 26 09:39:26 user nova-compute[74075]:         <nova:port uuid="f496eb03-2f60-485a-b706-06afc29b9a78">
Oct 26 09:39:26 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 09:39:26 user nova-compute[74075]:         </nova:port>
Oct 26 09:39:26 user nova-compute[74075]:       </nova:ports>
Oct 26 09:39:26 user nova-compute[74075]:     </nova:instance>
Oct 26 09:39:26 user nova-compute[74075]:   </metadata>
Oct 26 09:39:26 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:39:26 user nova-compute[74075]:     <system>
Oct 26 09:39:26 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:39:26 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:39:26 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:39:26 user nova-compute[74075]:       <entry name="serial">668b12c1-9874-472a-88ca-f6671d6a4ba6</entry>
Oct 26 09:39:26 user nova-compute[74075]:       <entry name="uuid">668b12c1-9874-472a-88ca-f6671d6a4ba6</entry>
Oct 26 09:39:26 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:39:26 user nova-compute[74075]:     </system>
Oct 26 09:39:26 user nova-compute[74075]:   </sysinfo>
Oct 26 09:39:26 user nova-compute[74075]:   <os>
Oct 26 09:39:26 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:39:26 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:39:26 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:39:26 user nova-compute[74075]:   </os>
Oct 26 09:39:26 user nova-compute[74075]:   <features>
Oct 26 09:39:26 user nova-compute[74075]:     <acpi/>
Oct 26 09:39:26 user nova-compute[74075]:     <apic/>
Oct 26 09:39:26 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:39:26 user nova-compute[74075]:   </features>
Oct 26 09:39:26 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:39:26 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:39:26 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:39:26 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:39:26 user nova-compute[74075]:   </clock>
Oct 26 09:39:26 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:39:26 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:39:26 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:39:26 user nova-compute[74075]:   </cpu>
Oct 26 09:39:26 user nova-compute[74075]:   <devices>
Oct 26 09:39:26 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:39:26 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:39:26 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk"/>
Oct 26 09:39:26 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:39:26 user nova-compute[74075]:     </disk>
Oct 26 09:39:26 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:39:26 user nova-compute[74075]:       <mac address="fa:16:3e:d2:3f:36"/>
Oct 26 09:39:26 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:39:26 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:39:26 user nova-compute[74075]:       <target dev="tapf496eb03-2f"/>
Oct 26 09:39:26 user nova-compute[74075]:     </interface>
Oct 26 09:39:26 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:39:26 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/console.log" append="off"/>
Oct 26 09:39:26 user nova-compute[74075]:     </serial>
Oct 26 09:39:26 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:39:26 user nova-compute[74075]:     <video>
Oct 26 09:39:26 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:39:26 user nova-compute[74075]:     </video>
Oct 26 09:39:26 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:39:26 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:39:26 user nova-compute[74075]:     </rng>
Oct 26 09:39:26 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:39:26 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:39:26 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:39:26 user nova-compute[74075]:     </memballoon>
Oct 26 09:39:26 user nova-compute[74075]:   </devices>
Oct 26 09:39:26 user nova-compute[74075]: </domain>
Oct 26 09:39:26 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834608990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834608990',id=26,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-mrg5hmq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:39:24Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=668b12c1-9874-472a-88ca-f6671d6a4ba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG os_vif [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aca21128-a879-519e-a0f9-c436fab3accc', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf496eb03-2f, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf496eb03-2f, col_values=(('qos', UUID('1b01e0cf-356f-4be0-8ef8-78f0233678eb')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf496eb03-2f, col_values=(('external_ids', {'iface-id': 'f496eb03-2f60-485a-b706-06afc29b9a78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:3f:36', 'vm-uuid': '668b12c1-9874-472a-88ca-f6671d6a4ba6'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:26 user nova-compute[74075]: INFO os_vif [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f')
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No VIF found with MAC fa:16:3e:d2:3f:36, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Updated VIF entry in instance network info cache for port f496eb03-2f60-485a-b706-06afc29b9a78. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Updating instance_info_cache with network_info: [{"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-96bfe751-0e8f-43db-84ed-491c23deebe8 req-1783287c-e5c6-4f60-918d-cebe8508d5a6 service nova] Releasing lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:39:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-909cd864-8591-41f2-975b-6aa823333abe req-a0545d92-f936-4365-b219-60d0d33a999a service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-909cd864-8591-41f2-975b-6aa823333abe req-a0545d92-f936-4365-b219-60d0d33a999a service nova] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-909cd864-8591-41f2-975b-6aa823333abe req-a0545d92-f936-4365-b219-60d0d33a999a service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-909cd864-8591-41f2-975b-6aa823333abe req-a0545d92-f936-4365-b219-60d0d33a999a service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-909cd864-8591-41f2-975b-6aa823333abe req-a0545d92-f936-4365-b219-60d0d33a999a service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] No waiting events found dispatching network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:28 user nova-compute[74075]: WARNING nova.compute.manager [req-909cd864-8591-41f2-975b-6aa823333abe req-a0545d92-f936-4365-b219-60d0d33a999a service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received unexpected event network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 for instance with vm_state building and task_state spawning.
Oct 26 09:39:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:39:30 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Instance spawned successfully.
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-776fdacc-f59f-410e-99f2-7bc44adeba5f req-4a52d8b4-ac06-412d-a0b7-07b12266267a service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-776fdacc-f59f-410e-99f2-7bc44adeba5f req-4a52d8b4-ac06-412d-a0b7-07b12266267a service nova] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-776fdacc-f59f-410e-99f2-7bc44adeba5f req-4a52d8b4-ac06-412d-a0b7-07b12266267a service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-776fdacc-f59f-410e-99f2-7bc44adeba5f req-4a52d8b4-ac06-412d-a0b7-07b12266267a service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-776fdacc-f59f-410e-99f2-7bc44adeba5f req-4a52d8b4-ac06-412d-a0b7-07b12266267a service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] No waiting events found dispatching network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:30 user nova-compute[74075]: WARNING nova.compute.manager [req-776fdacc-f59f-410e-99f2-7bc44adeba5f req-4a52d8b4-ac06-412d-a0b7-07b12266267a service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received unexpected event network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 for instance with vm_state building and task_state spawning.
Oct 26 09:39:30 user nova-compute[74075]: INFO nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 26 09:39:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:39:30 user nova-compute[74075]: INFO nova.compute.manager [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Took 6.44 seconds to build instance.
Oct 26 09:39:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ec3e3431-d350-4070-963f-c34905e65a3e tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.572s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:39:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:38 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:39:38 user nova-compute[74075]: INFO nova.compute.claims [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Claim successful on node user
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:39:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.policy [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7604ae732734f05aaa7aeebf8ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07b30415774466817048f8090437ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:39:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Creating image(s)
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.233s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk 1073741824" returned: 0 in 0.054s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Successfully created port: ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.267s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Cannot resize image /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Ensure instance console log exists: /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Successfully updated port: ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquired lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-changed-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Refreshing instance network info cache due to event network-changed-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] Acquiring lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updating instance_info_cache with network_info: [{"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Releasing lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Instance network_info: |[{"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] Acquired lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Refreshing network info cache for port ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Start _get_guest_xml network_info=[{"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:39:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:39:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1735452153',display_name='tempest-AttachVolumeNegativeTest-server-1735452153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1735452153',id=27,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFDLIftlo07xdMBcOwDojr5yKaQwU4umgOwuY0HpLXvV+g04mGE2n3VWok4todv1ojiiurvo1NpxiirLe+oAwAClmXdJin7H3GRj8cuxTQt42gfSm+Oj9yhaei9dY9TZQ==',key_name='tempest-keypair-1981167971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-lmxkb932',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=c2e39968-f46d-443d-a7af-f60dd087e905,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'pci_devices' on Instance uuid c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:39:41 user nova-compute[74075]:   <uuid>c2e39968-f46d-443d-a7af-f60dd087e905</uuid>
Oct 26 09:39:41 user nova-compute[74075]:   <name>instance-0000001b</name>
Oct 26 09:39:41 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:39:41 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:39:41 user nova-compute[74075]:   <metadata>
Oct 26 09:39:41 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:39:41 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:39:41 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1735452153</nova:name>
Oct 26 09:39:41 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:39:41</nova:creationTime>
Oct 26 09:39:41 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:39:41 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:39:41 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:39:41 user nova-compute[74075]:       <nova:owner>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:user uuid="c7604ae732734f05aaa7aeebf8ef5e1a">tempest-AttachVolumeNegativeTest-294403091-project-member</nova:user>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:project uuid="2e07b30415774466817048f8090437ee">tempest-AttachVolumeNegativeTest-294403091</nova:project>
Oct 26 09:39:41 user nova-compute[74075]:       </nova:owner>
Oct 26 09:39:41 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:39:41 user nova-compute[74075]:       <nova:ports>
Oct 26 09:39:41 user nova-compute[74075]:         <nova:port uuid="ecd03ba6-ea12-46a5-8e16-4328b52bc0fa">
Oct 26 09:39:41 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 09:39:41 user nova-compute[74075]:         </nova:port>
Oct 26 09:39:41 user nova-compute[74075]:       </nova:ports>
Oct 26 09:39:41 user nova-compute[74075]:     </nova:instance>
Oct 26 09:39:41 user nova-compute[74075]:   </metadata>
Oct 26 09:39:41 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:39:41 user nova-compute[74075]:     <system>
Oct 26 09:39:41 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:39:41 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:39:41 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:39:41 user nova-compute[74075]:       <entry name="serial">c2e39968-f46d-443d-a7af-f60dd087e905</entry>
Oct 26 09:39:41 user nova-compute[74075]:       <entry name="uuid">c2e39968-f46d-443d-a7af-f60dd087e905</entry>
Oct 26 09:39:41 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:39:41 user nova-compute[74075]:     </system>
Oct 26 09:39:41 user nova-compute[74075]:   </sysinfo>
Oct 26 09:39:41 user nova-compute[74075]:   <os>
Oct 26 09:39:41 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:39:41 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:39:41 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:39:41 user nova-compute[74075]:   </os>
Oct 26 09:39:41 user nova-compute[74075]:   <features>
Oct 26 09:39:41 user nova-compute[74075]:     <acpi/>
Oct 26 09:39:41 user nova-compute[74075]:     <apic/>
Oct 26 09:39:41 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:39:41 user nova-compute[74075]:   </features>
Oct 26 09:39:41 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:39:41 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:39:41 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:39:41 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:39:41 user nova-compute[74075]:   </clock>
Oct 26 09:39:41 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:39:41 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:39:41 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:39:41 user nova-compute[74075]:   </cpu>
Oct 26 09:39:41 user nova-compute[74075]:   <devices>
Oct 26 09:39:41 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:39:41 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:39:41 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk"/>
Oct 26 09:39:41 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:39:41 user nova-compute[74075]:     </disk>
Oct 26 09:39:41 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:39:41 user nova-compute[74075]:       <mac address="fa:16:3e:a7:f6:b4"/>
Oct 26 09:39:41 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:39:41 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:39:41 user nova-compute[74075]:       <target dev="tapecd03ba6-ea"/>
Oct 26 09:39:41 user nova-compute[74075]:     </interface>
Oct 26 09:39:41 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:39:41 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/console.log" append="off"/>
Oct 26 09:39:41 user nova-compute[74075]:     </serial>
Oct 26 09:39:41 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:39:41 user nova-compute[74075]:     <video>
Oct 26 09:39:41 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:39:41 user nova-compute[74075]:     </video>
Oct 26 09:39:41 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:39:41 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:39:41 user nova-compute[74075]:     </rng>
Oct 26 09:39:41 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:39:41 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:39:41 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:39:41 user nova-compute[74075]:     </memballoon>
Oct 26 09:39:41 user nova-compute[74075]:   </devices>
Oct 26 09:39:41 user nova-compute[74075]: </domain>
Oct 26 09:39:41 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1735452153',display_name='tempest-AttachVolumeNegativeTest-server-1735452153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1735452153',id=27,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFDLIftlo07xdMBcOwDojr5yKaQwU4umgOwuY0HpLXvV+g04mGE2n3VWok4todv1ojiiurvo1NpxiirLe+oAwAClmXdJin7H3GRj8cuxTQt42gfSm+Oj9yhaei9dY9TZQ==',key_name='tempest-keypair-1981167971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-lmxkb932',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=c2e39968-f46d-443d-a7af-f60dd087e905,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG os_vif [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df1ccad4-592b-59a1-92e5-91b7dce93bbd', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecd03ba6-ea, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecd03ba6-ea, col_values=(('qos', UUID('423f8680-c5e4-4b88-a055-c7de4f9c3f88')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecd03ba6-ea, col_values=(('external_ids', {'iface-id': 'ecd03ba6-ea12-46a5-8e16-4328b52bc0fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f6:b4', 'vm-uuid': 'c2e39968-f46d-443d-a7af-f60dd087e905'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: INFO os_vif [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea')
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:a7:f6:b4, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:41 user nova-compute[74075]: INFO nova.compute.manager [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Terminating instance
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updated VIF entry in instance network info cache for port ecd03ba6-ea12-46a5-8e16-4328b52bc0fa. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updating instance_info_cache with network_info: [{"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ab2427e9-885c-4919-908d-563b36cf636d req-6dd63812-0183-49bf-9c06-d5fc462c5f56 service nova] Releasing lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-65139dac-7f6b-4952-a3f0-81b71826605c req-b49aea73-c4d7-432b-932a-50633a4267ac service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-65139dac-7f6b-4952-a3f0-81b71826605c req-b49aea73-c4d7-432b-932a-50633a4267ac service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-65139dac-7f6b-4952-a3f0-81b71826605c req-b49aea73-c4d7-432b-932a-50633a4267ac service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-65139dac-7f6b-4952-a3f0-81b71826605c req-b49aea73-c4d7-432b-932a-50633a4267ac service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-65139dac-7f6b-4952-a3f0-81b71826605c req-b49aea73-c4d7-432b-932a-50633a4267ac service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-65139dac-7f6b-4952-a3f0-81b71826605c req-b49aea73-c4d7-432b-932a-50633a4267ac service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-unplugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Instance destroyed successfully.
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'resources' on Instance uuid 0ed7d017-b761-4efe-9cc6-995fac04dd58 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494371913',display_name='tempest-ServerRescueNegativeTestJSON-server-494371913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494371913',id=19,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx/2xyx2khvJf9M6jt2G8MvWCuIOewmaKhtW8HAYNr666l+pDtMz3sB09XwYzZiqd0p+4Axm5iL+qYQE1Uc0D1F9F7LDpKJqX9Q3xKXA/rYBzjnu9kIwZWHmgPAMkUxKA==',key_name='tempest-keypair-2032257308',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-6p8lgs3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d86b9184a1410db33192820885da0f',uuid=0ed7d017-b761-4efe-9cc6-995fac04dd58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "address": "fa:16:3e:a2:8a:17", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bec6c3-c8", "ovs_interfaceid": "f1bec6c3-c88d-4e3e-bcea-b3f7eb728867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG os_vif [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1bec6c3-c8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c09a0efb-a837-4e10-87b9-910461df43d6) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: INFO os_vif [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8a:17,bridge_name='br-int',has_traffic_filtering=True,id=f1bec6c3-c88d-4e3e-bcea-b3f7eb728867,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bec6c3-c8')
Oct 26 09:39:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Deleting instance files /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58_del
Oct 26 09:39:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Deletion of /opt/stack/data/nova/instances/0ed7d017-b761-4efe-9cc6-995fac04dd58_del complete
Oct 26 09:39:43 user nova-compute[74075]: INFO nova.compute.manager [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 26 09:39:43 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:43 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:44 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Took 0.92 seconds to deallocate network for instance.
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-b33b16d5-5034-4291-9478-8e0c09b8b93f req-a65af44c-472e-4758-b292-e6a7f6efa9ed service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-deleted-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Acquiring lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] No waiting events found dispatching network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:44 user nova-compute[74075]: WARNING nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: 0ed7d017-b761-4efe-9cc6-995fac04dd58] Received unexpected event network-vif-plugged-f1bec6c3-c88d-4e3e-bcea-b3f7eb728867 for instance with vm_state deleted and task_state None.
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] No waiting events found dispatching network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:44 user nova-compute[74075]: WARNING nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received unexpected event network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa for instance with vm_state building and task_state spawning.
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] No waiting events found dispatching network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:44 user nova-compute[74075]: WARNING nova.compute.manager [req-5afe4158-18f6-4dca-b9c2-b76b6eae42dc req-cbca8bf5-ce7e-4dfa-819b-abada6e6c290 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received unexpected event network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa for instance with vm_state building and task_state spawning.
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:44 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Deleted allocations for instance 0ed7d017-b761-4efe-9cc6-995fac04dd58
Oct 26 09:39:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-69784cdf-2205-4822-91f4-b08705a6b8fa tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "0ed7d017-b761-4efe-9cc6-995fac04dd58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Instance spawned successfully.
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:39:45 user nova-compute[74075]: INFO nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 26 09:39:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:39:45 user nova-compute[74075]: INFO nova.compute.manager [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Took 6.99 seconds to build instance.
Oct 26 09:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-fcdb4fec-274b-401e-8a8a-90f8e1c5aae2 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.087s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:48 user nova-compute[74075]: INFO nova.compute.manager [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Terminating instance
Oct 26 09:39:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3a72595-0336-48f1-a08f-15430fed511f req-a7f1e902-1501-446e-95dd-c0a65c54b3b4 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-vif-unplugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3a72595-0336-48f1-a08f-15430fed511f req-a7f1e902-1501-446e-95dd-c0a65c54b3b4 service nova] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3a72595-0336-48f1-a08f-15430fed511f req-a7f1e902-1501-446e-95dd-c0a65c54b3b4 service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3a72595-0336-48f1-a08f-15430fed511f req-a7f1e902-1501-446e-95dd-c0a65c54b3b4 service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3a72595-0336-48f1-a08f-15430fed511f req-a7f1e902-1501-446e-95dd-c0a65c54b3b4 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] No waiting events found dispatching network-vif-unplugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3a72595-0336-48f1-a08f-15430fed511f req-a7f1e902-1501-446e-95dd-c0a65c54b3b4 service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-vif-unplugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:39:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Instance destroyed successfully.
Oct 26 09:39:49 user nova-compute[74075]: DEBUG nova.objects.instance [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lazy-loading 'resources' on Instance uuid 99c57de9-bad9-41f7-9b09-9b2e5ac85521 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1140593622',display_name='tempest-VolumesActionsTest-instance-1140593622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1140593622',id=25,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:37:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2c735fb27274a10a4005325bc5d9e4c',ramdisk_id='',reservation_id='r-zj8mo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1450383175',owner_user_name='tempest-VolumesActionsTest-1450383175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:37:57Z,user_data=None,user_id='701652cea9c342469f8b4bed5c3b89c1',uuid=99c57de9-bad9-41f7-9b09-9b2e5ac85521,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converting VIF {"id": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "address": "fa:16:3e:bf:2e:af", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab4aee-33", "ovs_interfaceid": "67ab4aee-3319-4e9c-b35b-d6ef736c3e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG os_vif [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67ab4aee-33, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=238c31d8-709c-47b2-b56f-3aa3b665d10a) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:39:49 user nova-compute[74075]: INFO os_vif [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2e:af,bridge_name='br-int',has_traffic_filtering=True,id=67ab4aee-3319-4e9c-b35b-d6ef736c3e14,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab4aee-33')
Oct 26 09:39:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Deleting instance files /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521_del
Oct 26 09:39:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Deletion of /opt/stack/data/nova/instances/99c57de9-bad9-41f7-9b09-9b2e5ac85521_del complete
Oct 26 09:39:49 user nova-compute[74075]: INFO nova.compute.manager [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 26 09:39:49 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:39:49 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:39:50 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Took 1.15 seconds to deallocate network for instance.
Oct 26 09:39:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] Acquiring lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] No waiting events found dispatching network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:39:50 user nova-compute[74075]: WARNING nova.compute.manager [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received unexpected event network-vif-plugged-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 for instance with vm_state active and task_state deleting.
Oct 26 09:39:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-873b17bb-d435-4ee2-8ce6-f33632ab03df req-d223a154-fe0c-49d3-9caf-a2d3b26cbe8d service nova] [instance: 99c57de9-bad9-41f7-9b09-9b2e5ac85521] Received event network-vif-deleted-67ab4aee-3319-4e9c-b35b-d6ef736c3e14 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:39:50 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:39:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:51 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Deleted allocations for instance 99c57de9-bad9-41f7-9b09-9b2e5ac85521
Oct 26 09:39:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-aa8f2d60-f904-47f8-92b6-66703da5b8b4 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "99c57de9-bad9-41f7-9b09-9b2e5ac85521" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.109s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:39:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:39:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:39:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:39:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:40:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:40:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:40:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7682MB free_disk=25.305538177490234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 839ef064-055b-4050-9c92-8913891abfe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b0ef0258-9bcd-4caa-822f-114e85431fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c2e39968-f46d-443d-a7af-f60dd087e905 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:40:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:40:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [{"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b0ef0258-9bcd-4caa-822f-114e85431fb5" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:12 user nova-compute[74075]: INFO nova.compute.manager [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Terminating instance
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:12 user nova-compute[74075]: INFO nova.compute.manager [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Terminating instance
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-70c78664-4d5c-4527-a35b-8caaa554f22e req-b86d01aa-d76e-4edf-b4a8-bf0db9f51727 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70c78664-4d5c-4527-a35b-8caaa554f22e req-b86d01aa-d76e-4edf-b4a8-bf0db9f51727 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70c78664-4d5c-4527-a35b-8caaa554f22e req-b86d01aa-d76e-4edf-b4a8-bf0db9f51727 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70c78664-4d5c-4527-a35b-8caaa554f22e req-b86d01aa-d76e-4edf-b4a8-bf0db9f51727 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-70c78664-4d5c-4527-a35b-8caaa554f22e req-b86d01aa-d76e-4edf-b4a8-bf0db9f51727 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-70c78664-4d5c-4527-a35b-8caaa554f22e req-b86d01aa-d76e-4edf-b4a8-bf0db9f51727 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-4421b0c5-e25c-4bd0-a78e-ef367b3c10eb req-257add3c-2fdb-498d-8183-a7fc443660fa service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-vif-unplugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4421b0c5-e25c-4bd0-a78e-ef367b3c10eb req-257add3c-2fdb-498d-8183-a7fc443660fa service nova] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4421b0c5-e25c-4bd0-a78e-ef367b3c10eb req-257add3c-2fdb-498d-8183-a7fc443660fa service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4421b0c5-e25c-4bd0-a78e-ef367b3c10eb req-257add3c-2fdb-498d-8183-a7fc443660fa service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-4421b0c5-e25c-4bd0-a78e-ef367b3c10eb req-257add3c-2fdb-498d-8183-a7fc443660fa service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] No waiting events found dispatching network-vif-unplugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-4421b0c5-e25c-4bd0-a78e-ef367b3c10eb req-257add3c-2fdb-498d-8183-a7fc443660fa service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-vif-unplugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Instance destroyed successfully.
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.objects.instance [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lazy-loading 'resources' on Instance uuid b0ef0258-9bcd-4caa-822f-114e85431fb5 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Instance destroyed successfully.
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lazy-loading 'resources' on Instance uuid dd7a3ed2-b161-4950-bbcc-8de9c33e2275 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1332623435',display_name='tempest-ServerActionsTestOtherB-server-1332623435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1332623435',id=15,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH227a1TKWPOKPKVFOCrSqYsWLuiKcObADQNZ9zsoNGu5Cp+Ps0GQwJOzIV0J6Czd2nC5xmYNYcWRHM6jF7FeV7kORtG8OlHgEc5y+WM9KZYGUstILosFuP52lxBVkL5nQ==',key_name='tempest-keypair-1011585399',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:37:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8c9daadd77642879f80a0233e0cb7fa',ramdisk_id='',reservation_id='r-3gz0hyjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-250783807',owner_user_name='tempest-ServerActionsTestOtherB-250783807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='577f9cb60ea940e48405553a6ddc7c18',uuid=b0ef0258-9bcd-4caa-822f-114e85431fb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converting VIF {"id": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "address": "fa:16:3e:7d:66:e0", "network": {"id": "d9829693-fdee-4e42-bf2b-efc1b50e18d7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1507576254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c9daadd77642879f80a0233e0cb7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f2ea36f-be", "ovs_interfaceid": "0f2ea36f-be05-482a-bd66-736c4d8b36f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_vif [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f2ea36f-be, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1854875769',display_name='tempest-ServersNegativeTestJSON-server-1854875769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1854875769',id=13,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:30:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d989d010e8bf4fcabfc7f5109432fa29',ramdisk_id='',reservation_id='r-6nse3gb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2029109923',owner_user_name='tempest-ServersNegativeTestJSON-2029109923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:30:45Z,user_data=None,user_id='72e41eeb99a44dde89e0c8530c4c3dbd',uuid=dd7a3ed2-b161-4950-bbcc-8de9c33e2275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converting VIF {"id": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "address": "fa:16:3e:37:1f:3d", "network": {"id": "2f7273c8-961a-434f-a37a-b1f07a3fed42", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1202236858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d989d010e8bf4fcabfc7f5109432fa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa35f6a7-e0", "ovs_interfaceid": "fa35f6a7-e07d-4fd1-9548-bf2a5bf40369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_vif [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa35f6a7-e0, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd931e03-94d3-44f9-9748-2b6a5dabebef) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16beefd6-2c18-442d-923f-9bc59ca8b004) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: INFO os_vif [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:66:e0,bridge_name='br-int',has_traffic_filtering=True,id=0f2ea36f-be05-482a-bd66-736c4d8b36f0,network=Network(d9829693-fdee-4e42-bf2b-efc1b50e18d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f2ea36f-be')
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:13 user nova-compute[74075]: INFO os_vif [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:1f:3d,bridge_name='br-int',has_traffic_filtering=True,id=fa35f6a7-e07d-4fd1-9548-bf2a5bf40369,network=Network(2f7273c8-961a-434f-a37a-b1f07a3fed42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa35f6a7-e0')
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Deleting instance files /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275_del
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Deletion of /opt/stack/data/nova/instances/dd7a3ed2-b161-4950-bbcc-8de9c33e2275_del complete
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woOWEkuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:40:13 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd3fa0-ba84-4b0b-8222-0b95b3799319]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:40:13 user nova-compute[74075]: No targets found.
Oct 26 09:40:13 user nova-compute[74075]: iSNS:
Oct 26 09:40:13 user nova-compute[74075]: No targets found.
Oct 26 09:40:13 user nova-compute[74075]: STATIC:
Oct 26 09:40:13 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d
Oct 26 09:40:13 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:40:13 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:40:13 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:40:13 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:40:13 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:40:13 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:40:13 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:40:13 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:40:13 user nova-compute[74075]: FIRMWARE:
Oct 26 09:40:13 user nova-compute[74075]: No targets found.
Oct 26 09:40:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:40:13 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:40:13 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae69dfb9-5a1a-404d-adbd-9ba5e0daf148]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.compute.manager [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b93739-6103-4593-815e-5b0d3c2dac71]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:40:13 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:40:13 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:40:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:40:13 user nova-compute[74075]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d (non-flash)
Oct 26 09:40:13 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:40:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[99179942-36eb-47cc-b2af-8bdb774da413]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc1ebf-223d-4f3b-b675-7bf6820567d1]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f99f0d-e256-418a-9040-c915458d34fc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.069s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[649b93d7-3586-4750-bb12-fc86c5c682c8]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09a2e3a-3e24-4cb7-b773-cd06a78e4a30]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a7324d-dcec-471f-a6b9-a234a1ebbe6b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260]
Oct 26 09:40:13 user nova-compute[74075]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d, portal: 172.16.0.220,3260] successful.
Oct 26 09:40:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3a46ef-ba07-4dab-a1e1-6f8f4e81728d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a4860-7ba1-4561-bf4d-476d0e83429a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] <== disconnect_volume: return (446ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Deleting instance files /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5_del
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Deletion of /opt/stack/data/nova/instances/b0ef0258-9bcd-4caa-822f-114e85431fb5_del complete
Oct 26 09:40:13 user nova-compute[74075]: INFO nova.compute.manager [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Took 1.83 seconds to destroy the instance on the hypervisor.
Oct 26 09:40:13 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:40:13 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:14 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Took 0.78 seconds to deallocate network for instance.
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:14 user nova-compute[74075]: WARNING nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state deleting.
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:14 user nova-compute[74075]: WARNING nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state deleting.
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:14 user nova-compute[74075]: WARNING nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state deleting.
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-unplugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Acquiring lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] No waiting events found dispatching network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:14 user nova-compute[74075]: WARNING nova.compute.manager [req-43f93475-b151-4efd-81e1-0a65f9e19cae req-78b35d6e-3b6b-4570-bd3e-a382fe0fb741 service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received unexpected event network-vif-plugged-0f2ea36f-be05-482a-bd66-736c4d8b36f0 for instance with vm_state active and task_state deleting.
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] Acquiring lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] No waiting events found dispatching network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:14 user nova-compute[74075]: WARNING nova.compute.manager [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received unexpected event network-vif-plugged-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 for instance with vm_state deleted and task_state None.
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-81c08720-fa79-40a8-bf6d-753e1b3af21d req-3dad2e93-3d4a-4042-b9d6-54f5fedc4b13 service nova] [instance: dd7a3ed2-b161-4950-bbcc-8de9c33e2275] Received event network-vif-deleted-fa35f6a7-e07d-4fd1-9548-bf2a5bf40369 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Deleted allocations for instance dd7a3ed2-b161-4950-bbcc-8de9c33e2275
Oct 26 09:40:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b654244f-4b2a-41d0-aea3-19ddf2b7187e tempest-ServersNegativeTestJSON-2029109923 tempest-ServersNegativeTestJSON-2029109923-project-member] Lock "dd7a3ed2-b161-4950-bbcc-8de9c33e2275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:14 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:14 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Took 1.10 seconds to deallocate network for instance.
Oct 26 09:40:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-75923242-9892-4329-b59e-2525970b0311 req-bb9f951c-f290-46ec-8c87-c2bb94d572ab service nova] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Received event network-vif-deleted-0f2ea36f-be05-482a-bd66-736c4d8b36f0 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:15 user nova-compute[74075]: INFO nova.compute.manager [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] [instance: b0ef0258-9bcd-4caa-822f-114e85431fb5] Took 0.84 seconds to detach 1 volumes for instance.
Oct 26 09:40:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:16 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:40:16 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:40:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:16 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Deleted allocations for instance b0ef0258-9bcd-4caa-822f-114e85431fb5
Oct 26 09:40:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-456feca9-26df-46b6-830d-849bad0fd374 tempest-ServerActionsTestOtherB-250783807 tempest-ServerActionsTestOtherB-250783807-project-member] Lock "b0ef0258-9bcd-4caa-822f-114e85431fb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.277s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:40:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:37 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:40:37 user nova-compute[74075]: INFO nova.compute.claims [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Claim successful on node user
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:40:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:40:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Creating image(s)
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "/opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "/opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "/opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG nova.policy [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6bab0fb35654e769202e040661997a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90542bf6a4a4622a6b37f1fd0e46b73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.214s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Successfully created port: a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Cannot resize image /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Ensure instance console log exists: /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:40:39 user nova-compute[74075]: INFO nova.compute.claims [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Claim successful on node user
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Successfully updated port: a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "refresh_cache-95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquired lock "refresh_cache-95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:40:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-changed-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Refreshing instance network info cache due to event network-changed-a73c71ef-6de4-4732-a7a2-e54082148980. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] Acquiring lock "refresh_cache-95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Updating instance_info_cache with network_info: [{"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Releasing lock "refresh_cache-95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Instance network_info: |[{"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] Acquired lock "refresh_cache-95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Refreshing network info cache for port a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Start _get_guest_xml network_info=[{"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:40:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:40:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-921691787',display_name='tempest-VolumesNegativeTest-instance-921691787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-921691787',id=28,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e90542bf6a4a4622a6b37f1fd0e46b73',ramdisk_id='',reservation_id='r-h07pr34k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1243883127',owner_user_name='tempest-VolumesNegativeTest-1243883127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:40:38Z,user_data=None,user_id='a6bab0fb35654e769202e040661997a8',uuid=95203f61-c0f4-4fc0-a13c-cf8d11ba32e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Converting VIF {"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lazy-loading 'pci_devices' on Instance uuid 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:40:40 user nova-compute[74075]:   <uuid>95203f61-c0f4-4fc0-a13c-cf8d11ba32e7</uuid>
Oct 26 09:40:40 user nova-compute[74075]:   <name>instance-0000001c</name>
Oct 26 09:40:40 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:40:40 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:40:40 user nova-compute[74075]:   <metadata>
Oct 26 09:40:40 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:40:40 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:40:40 user nova-compute[74075]:       <nova:name>tempest-VolumesNegativeTest-instance-921691787</nova:name>
Oct 26 09:40:40 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:40:40</nova:creationTime>
Oct 26 09:40:40 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:40:40 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:40:40 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:40:40 user nova-compute[74075]:       <nova:owner>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:user uuid="a6bab0fb35654e769202e040661997a8">tempest-VolumesNegativeTest-1243883127-project-member</nova:user>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:project uuid="e90542bf6a4a4622a6b37f1fd0e46b73">tempest-VolumesNegativeTest-1243883127</nova:project>
Oct 26 09:40:40 user nova-compute[74075]:       </nova:owner>
Oct 26 09:40:40 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:40:40 user nova-compute[74075]:       <nova:ports>
Oct 26 09:40:40 user nova-compute[74075]:         <nova:port uuid="a73c71ef-6de4-4732-a7a2-e54082148980">
Oct 26 09:40:40 user nova-compute[74075]:           <nova:ip type="fixed" address="192.168.233.248" ipVersion="4"/>
Oct 26 09:40:40 user nova-compute[74075]:         </nova:port>
Oct 26 09:40:40 user nova-compute[74075]:       </nova:ports>
Oct 26 09:40:40 user nova-compute[74075]:     </nova:instance>
Oct 26 09:40:40 user nova-compute[74075]:   </metadata>
Oct 26 09:40:40 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:40:40 user nova-compute[74075]:     <system>
Oct 26 09:40:40 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:40:40 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:40:40 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:40:40 user nova-compute[74075]:       <entry name="serial">95203f61-c0f4-4fc0-a13c-cf8d11ba32e7</entry>
Oct 26 09:40:40 user nova-compute[74075]:       <entry name="uuid">95203f61-c0f4-4fc0-a13c-cf8d11ba32e7</entry>
Oct 26 09:40:40 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:40:40 user nova-compute[74075]:     </system>
Oct 26 09:40:40 user nova-compute[74075]:   </sysinfo>
Oct 26 09:40:40 user nova-compute[74075]:   <os>
Oct 26 09:40:40 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:40:40 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:40:40 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:40:40 user nova-compute[74075]:   </os>
Oct 26 09:40:40 user nova-compute[74075]:   <features>
Oct 26 09:40:40 user nova-compute[74075]:     <acpi/>
Oct 26 09:40:40 user nova-compute[74075]:     <apic/>
Oct 26 09:40:40 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:40:40 user nova-compute[74075]:   </features>
Oct 26 09:40:40 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:40:40 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:40:40 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:40:40 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:40:40 user nova-compute[74075]:   </clock>
Oct 26 09:40:40 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:40:40 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:40:40 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:40:40 user nova-compute[74075]:   </cpu>
Oct 26 09:40:40 user nova-compute[74075]:   <devices>
Oct 26 09:40:40 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:40:40 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:40:40 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk"/>
Oct 26 09:40:40 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:40:40 user nova-compute[74075]:     </disk>
Oct 26 09:40:40 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:40:40 user nova-compute[74075]:       <mac address="fa:16:3e:aa:44:e2"/>
Oct 26 09:40:40 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:40:40 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:40:40 user nova-compute[74075]:       <target dev="tapa73c71ef-6d"/>
Oct 26 09:40:40 user nova-compute[74075]:     </interface>
Oct 26 09:40:40 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:40:40 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/console.log" append="off"/>
Oct 26 09:40:40 user nova-compute[74075]:     </serial>
Oct 26 09:40:40 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:40:40 user nova-compute[74075]:     <video>
Oct 26 09:40:40 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:40:40 user nova-compute[74075]:     </video>
Oct 26 09:40:40 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:40:40 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:40:40 user nova-compute[74075]:     </rng>
Oct 26 09:40:40 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:40:40 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:40:40 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:40:40 user nova-compute[74075]:     </memballoon>
Oct 26 09:40:40 user nova-compute[74075]:   </devices>
Oct 26 09:40:40 user nova-compute[74075]: </domain>
Oct 26 09:40:40 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-921691787',display_name='tempest-VolumesNegativeTest-instance-921691787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-921691787',id=28,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e90542bf6a4a4622a6b37f1fd0e46b73',ramdisk_id='',reservation_id='r-h07pr34k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1243883127',owner_user_name='tempest-VolumesNegativeTest-1243883127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:40:38Z,user_data=None,user_id='a6bab0fb35654e769202e040661997a8',uuid=95203f61-c0f4-4fc0-a13c-cf8d11ba32e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Converting VIF {"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG os_vif [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '742232c9-490d-582f-8deb-d0c418f4fc5e', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73c71ef-6d, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa73c71ef-6d, col_values=(('qos', UUID('89168f0d-93a1-4abb-8a5c-36b317f557c2')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa73c71ef-6d, col_values=(('external_ids', {'iface-id': 'a73c71ef-6de4-4732-a7a2-e54082148980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:44:e2', 'vm-uuid': '95203f61-c0f4-4fc0-a13c-cf8d11ba32e7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:40 user nova-compute[74075]: INFO os_vif [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d')
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:40:40 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] No VIF found with MAC fa:16:3e:aa:44:e2, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.policy [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '701652cea9c342469f8b4bed5c3b89c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c735fb27274a10a4005325bc5d9e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:40:40 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Creating image(s)
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "/opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "/opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "/opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Updated VIF entry in instance network info cache for port a73c71ef-6de4-4732-a7a2-e54082148980. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Updating instance_info_cache with network_info: [{"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-582a2e14-0b4b-4527-bad1-15d444df924b req-d683136e-575a-43c8-975f-5a2d808851e6 service nova] Releasing lock "refresh_cache-95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Successfully created port: a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.189s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Cannot resize image /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Ensure instance console log exists: /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:41 user nova-compute[74075]: INFO nova.compute.manager [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Detaching volume 4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:40:41 user nova-compute[74075]: INFO nova.virt.block_device [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Attempting to driver detach volume 4e06e564-21de-4bc9-925c-8c5eee3771b5 from mountpoint /dev/vdb
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Attempting to detach device vdb from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:40:41 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:40:41 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:40:41 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:40:41 user nova-compute[74075]:   <serial>4e06e564-21de-4bc9-925c-8c5eee3771b5</serial>
Oct 26 09:40:41 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 09:40:41 user nova-compute[74075]: </disk>
Oct 26 09:40:41 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:40:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully detached device vdb from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 from the persistent domain config.
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:40:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:40:41 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:40:41 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:40:41 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:40:41 user nova-compute[74075]:   <serial>4e06e564-21de-4bc9-925c-8c5eee3771b5</serial>
Oct 26 09:40:41 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 09:40:41 user nova-compute[74075]: </disk>
Oct 26 09:40:41 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Successfully updated port: a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "refresh_cache-9998d4b6-af1d-4e96-8bf5-6038a90f8043" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquired lock "refresh_cache-9998d4b6-af1d-4e96-8bf5-6038a90f8043" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Received event network-changed-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Refreshing instance network info cache due to event network-changed-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] Acquiring lock "refresh_cache-9998d4b6-af1d-4e96-8bf5-6038a90f8043" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Updating instance_info_cache with network_info: [{"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Releasing lock "refresh_cache-9998d4b6-af1d-4e96-8bf5-6038a90f8043" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Instance network_info: |[{"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] Acquired lock "refresh_cache-9998d4b6-af1d-4e96-8bf5-6038a90f8043" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Refreshing network info cache for port a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Start _get_guest_xml network_info=[{"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:40:42 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:40:42 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-450323532',display_name='tempest-VolumesActionsTest-instance-450323532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-450323532',id=29,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2c735fb27274a10a4005325bc5d9e4c',ramdisk_id='',reservation_id='r-h2g2k84p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450383175',owner_user_name='tempest-VolumesActionsTest-1450383175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:40:41Z,user_data=None,user_id='701652cea9c342469f8b4bed5c3b89c1',uuid=9998d4b6-af1d-4e96-8bf5-6038a90f8043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converting VIF {"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lazy-loading 'pci_devices' on Instance uuid 9998d4b6-af1d-4e96-8bf5-6038a90f8043 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:40:42 user nova-compute[74075]:   <uuid>9998d4b6-af1d-4e96-8bf5-6038a90f8043</uuid>
Oct 26 09:40:42 user nova-compute[74075]:   <name>instance-0000001d</name>
Oct 26 09:40:42 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:40:42 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:40:42 user nova-compute[74075]:   <metadata>
Oct 26 09:40:42 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:40:42 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:40:42 user nova-compute[74075]:       <nova:name>tempest-VolumesActionsTest-instance-450323532</nova:name>
Oct 26 09:40:42 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:40:42</nova:creationTime>
Oct 26 09:40:42 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:40:42 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:40:42 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:40:42 user nova-compute[74075]:       <nova:owner>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:user uuid="701652cea9c342469f8b4bed5c3b89c1">tempest-VolumesActionsTest-1450383175-project-member</nova:user>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:project uuid="d2c735fb27274a10a4005325bc5d9e4c">tempest-VolumesActionsTest-1450383175</nova:project>
Oct 26 09:40:42 user nova-compute[74075]:       </nova:owner>
Oct 26 09:40:42 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:40:42 user nova-compute[74075]:       <nova:ports>
Oct 26 09:40:42 user nova-compute[74075]:         <nova:port uuid="a0b8a0f5-136c-4b57-8488-c75f67eb1e4f">
Oct 26 09:40:42 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 09:40:42 user nova-compute[74075]:         </nova:port>
Oct 26 09:40:42 user nova-compute[74075]:       </nova:ports>
Oct 26 09:40:42 user nova-compute[74075]:     </nova:instance>
Oct 26 09:40:42 user nova-compute[74075]:   </metadata>
Oct 26 09:40:42 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:40:42 user nova-compute[74075]:     <system>
Oct 26 09:40:42 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:40:42 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:40:42 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:40:42 user nova-compute[74075]:       <entry name="serial">9998d4b6-af1d-4e96-8bf5-6038a90f8043</entry>
Oct 26 09:40:42 user nova-compute[74075]:       <entry name="uuid">9998d4b6-af1d-4e96-8bf5-6038a90f8043</entry>
Oct 26 09:40:42 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:40:42 user nova-compute[74075]:     </system>
Oct 26 09:40:42 user nova-compute[74075]:   </sysinfo>
Oct 26 09:40:42 user nova-compute[74075]:   <os>
Oct 26 09:40:42 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:40:42 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:40:42 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:40:42 user nova-compute[74075]:   </os>
Oct 26 09:40:42 user nova-compute[74075]:   <features>
Oct 26 09:40:42 user nova-compute[74075]:     <acpi/>
Oct 26 09:40:42 user nova-compute[74075]:     <apic/>
Oct 26 09:40:42 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:40:42 user nova-compute[74075]:   </features>
Oct 26 09:40:42 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:40:42 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:40:42 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:40:42 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:40:42 user nova-compute[74075]:   </clock>
Oct 26 09:40:42 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:40:42 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:40:42 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:40:42 user nova-compute[74075]:   </cpu>
Oct 26 09:40:42 user nova-compute[74075]:   <devices>
Oct 26 09:40:42 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:40:42 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:40:42 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk"/>
Oct 26 09:40:42 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:40:42 user nova-compute[74075]:     </disk>
Oct 26 09:40:42 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:40:42 user nova-compute[74075]:       <mac address="fa:16:3e:ab:f0:a9"/>
Oct 26 09:40:42 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:40:42 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:40:42 user nova-compute[74075]:       <target dev="tapa0b8a0f5-13"/>
Oct 26 09:40:42 user nova-compute[74075]:     </interface>
Oct 26 09:40:42 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:40:42 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/console.log" append="off"/>
Oct 26 09:40:42 user nova-compute[74075]:     </serial>
Oct 26 09:40:42 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:40:42 user nova-compute[74075]:     <video>
Oct 26 09:40:42 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:40:42 user nova-compute[74075]:     </video>
Oct 26 09:40:42 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:40:42 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:40:42 user nova-compute[74075]:     </rng>
Oct 26 09:40:42 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:40:42 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:40:42 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:40:42 user nova-compute[74075]:     </memballoon>
Oct 26 09:40:42 user nova-compute[74075]:   </devices>
Oct 26 09:40:42 user nova-compute[74075]: </domain>
Oct 26 09:40:42 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-450323532',display_name='tempest-VolumesActionsTest-instance-450323532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-450323532',id=29,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2c735fb27274a10a4005325bc5d9e4c',ramdisk_id='',reservation_id='r-h2g2k84p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1450383175',owner_user_name='tempest-VolumesActionsTest-1450383175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:40:41Z,user_data=None,user_id='701652cea9c342469f8b4bed5c3b89c1',uuid=9998d4b6-af1d-4e96-8bf5-6038a90f8043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converting VIF {"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG os_vif [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '318a9f4c-2bd1-5af3-bab3-2bd584163836', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0b8a0f5-13, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0b8a0f5-13, col_values=(('qos', UUID('46667d69-6bdb-4e2b-8040-686933c1a528')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0b8a0f5-13, col_values=(('external_ids', {'iface-id': 'a0b8a0f5-136c-4b57-8488-c75f67eb1e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:f0:a9', 'vm-uuid': '9998d4b6-af1d-4e96-8bf5-6038a90f8043'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:42 user nova-compute[74075]: INFO os_vif [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13')
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-367f84ba-94be-42a4-b844-b5b607e74577 req-9a264de3-cea2-4705-95c3-449545058fca service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-367f84ba-94be-42a4-b844-b5b607e74577 req-9a264de3-cea2-4705-95c3-449545058fca service nova] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-367f84ba-94be-42a4-b844-b5b607e74577 req-9a264de3-cea2-4705-95c3-449545058fca service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-367f84ba-94be-42a4-b844-b5b607e74577 req-9a264de3-cea2-4705-95c3-449545058fca service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-367f84ba-94be-42a4-b844-b5b607e74577 req-9a264de3-cea2-4705-95c3-449545058fca service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] No waiting events found dispatching network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:42 user nova-compute[74075]: WARNING nova.compute.manager [req-367f84ba-94be-42a4-b844-b5b607e74577 req-9a264de3-cea2-4705-95c3-449545058fca service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received unexpected event network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 for instance with vm_state building and task_state spawning.
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:40:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] No VIF found with MAC fa:16:3e:ab:f0:a9, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Updated VIF entry in instance network info cache for port a0b8a0f5-136c-4b57-8488-c75f67eb1e4f. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Updating instance_info_cache with network_info: [{"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ad83b74-3b81-425a-92b9-2e0e2da8c637 req-53c4da40-4883-4702-8037-5dff00d4dbed service nova] Releasing lock "refresh_cache-9998d4b6-af1d-4e96-8bf5-6038a90f8043" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] No waiting events found dispatching network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:44 user nova-compute[74075]: WARNING nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received unexpected event network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 for instance with vm_state building and task_state spawning.
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Received event network-vif-plugged-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Acquiring lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] No waiting events found dispatching network-vif-plugged-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:44 user nova-compute[74075]: WARNING nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Received unexpected event network-vif-plugged-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f for instance with vm_state building and task_state spawning.
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Received event network-vif-plugged-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Acquiring lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] No waiting events found dispatching network-vif-plugged-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:44 user nova-compute[74075]: WARNING nova.compute.manager [req-7bc4c63e-7e92-4477-a928-5cba96998d02 req-12d21ce7-7571-44cc-b96e-444d7c27caea service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Received unexpected event network-vif-plugged-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f for instance with vm_state building and task_state spawning.
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 58346cfe-b396-4dbf-9a7a-b166f73fdb0e {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 668b12c1-9874-472a-88ca-f6671d6a4ba6 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 9998d4b6-af1d-4e96-8bf5-6038a90f8043 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "839ef064-055b-4050-9c92-8913891abfe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "839ef064-055b-4050-9c92-8913891abfe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Instance spawned successfully.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Took 7.79 seconds to spawn the instance on the hypervisor.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.compute.manager [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Took 8.58 seconds to build instance.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8b9057ee-3e37-44bc-967f-ad44f8d513d0 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.685s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.391s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Instance spawned successfully.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.compute.manager [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Took 7.09 seconds to build instance.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be187fcc-bdf9-4751-884e-c2180ff7ce3c tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.219s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.046s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:46 user nova-compute[74075]: INFO nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 26 09:40:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:40:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:40:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:40:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "839ef064-055b-4050-9c92-8913891abfe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:54 user nova-compute[74075]: INFO nova.compute.manager [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Terminating instance
Oct 26 09:40:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-7d5b9cd2-5b8a-4766-8e14-3337f1205ab8 req-f9584e40-a75a-4e7c-a027-d1ae6563344e service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-unplugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7d5b9cd2-5b8a-4766-8e14-3337f1205ab8 req-f9584e40-a75a-4e7c-a027-d1ae6563344e service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7d5b9cd2-5b8a-4766-8e14-3337f1205ab8 req-f9584e40-a75a-4e7c-a027-d1ae6563344e service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7d5b9cd2-5b8a-4766-8e14-3337f1205ab8 req-f9584e40-a75a-4e7c-a027-d1ae6563344e service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-7d5b9cd2-5b8a-4766-8e14-3337f1205ab8 req-f9584e40-a75a-4e7c-a027-d1ae6563344e service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-unplugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-7d5b9cd2-5b8a-4766-8e14-3337f1205ab8 req-f9584e40-a75a-4e7c-a027-d1ae6563344e service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-unplugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:40:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Instance destroyed successfully.
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'resources' on Instance uuid 839ef064-055b-4050-9c92-8913891abfe3 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1379992131',display_name='tempest-ServerRescueNegativeTestJSON-server-1379992131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1379992131',id=2,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-2bwn082t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:25:59Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=839ef064-055b-4050-9c92-8913891abfe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "address": "fa:16:3e:b9:b5:9b", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacc94ad-3b", "ovs_interfaceid": "bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG os_vif [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbacc94ad-3b, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bdb979d-388e-44a4-8f1f-1a73437d84b1) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:40:55 user nova-compute[74075]: INFO os_vif [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b5:9b,bridge_name='br-int',has_traffic_filtering=True,id=bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacc94ad-3b')
Oct 26 09:40:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Deleting instance files /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3_del
Oct 26 09:40:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Deletion of /opt/stack/data/nova/instances/839ef064-055b-4050-9c92-8913891abfe3_del complete
Oct 26 09:40:55 user nova-compute[74075]: INFO nova.compute.manager [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Took 0.78 seconds to destroy the instance on the hypervisor.
Oct 26 09:40:55 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:40:55 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Took 0.43 seconds to deallocate network for instance.
Oct 26 09:40:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:56 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:40:56 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:40:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:56 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Deleted allocations for instance 839ef064-055b-4050-9c92-8913891abfe3
Oct 26 09:40:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2f53395-5a0a-44b7-8497-c995fc37e379 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "839ef064-055b-4050-9c92-8913891abfe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.778s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] Acquiring lock "839ef064-055b-4050-9c92-8913891abfe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:40:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:40:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] Lock "839ef064-055b-4050-9c92-8913891abfe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:40:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] No waiting events found dispatching network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:40:57 user nova-compute[74075]: WARNING nova.compute.manager [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received unexpected event network-vif-plugged-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 for instance with vm_state deleted and task_state None.
Oct 26 09:40:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-e261ed1b-fe45-4b1f-9179-fbdfd6120dc8 req-9ca4301f-b30b-48fd-9486-915af8c868de service nova] [instance: 839ef064-055b-4050-9c92-8913891abfe3] Received event network-vif-deleted-bacc94ad-3b73-4ee8-8a2e-fcfc9ab8eac9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:40:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:40:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 is timed out.
Oct 26 09:41:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully detached device vdb from instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 from the live domain config.
Oct 26 09:41:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnLOimAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:41:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd6c60-ec91-49e0-93b9-9bdafa9cfca6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:41:02 user nova-compute[74075]: No targets found.
Oct 26 09:41:02 user nova-compute[74075]: iSNS:
Oct 26 09:41:02 user nova-compute[74075]: No targets found.
Oct 26 09:41:02 user nova-compute[74075]: STATIC:
Oct 26 09:41:02 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5
Oct 26 09:41:02 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:41:02 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:41:02 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:41:02 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:41:02 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:41:02 user nova-compute[74075]: FIRMWARE:
Oct 26 09:41:02 user nova-compute[74075]: No targets found.
Oct 26 09:41:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:41:02 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:41:02 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7f71e-f0bc-471a-962e-65f1e2122c6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[01542346-cf95-4fa4-8a37-cf38dbfd3679]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:41:02 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:41:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:41:02 user nova-compute[74075]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 (non-flash)
Oct 26 09:41:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb21d70-986c-4acb-a0a5-53615c86b3d7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb555bcc-ab5e-417c-b721-428af7c4cb7d]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1018d553-311d-40d4-a977-1cdf41e60b42]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f771ca9-05a5-45b8-9423-1e97d523b499]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068579b-280e-476a-8311-a0c965e14068]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af2d78-cfde-4e8e-b030-2029510b6197]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260]
Oct 26 09:41:02 user nova-compute[74075]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5, portal: 172.16.0.220,3260] successful.
Oct 26 09:41:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e06e564-21de-4bc9-925c-8c5eee3771b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3be67d-edc7-4000-8728-a0b1af3d5c7e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== disconnect_volume: return (315ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'flavor' on Instance uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-008a1e3f-6288-4753-9d3f-3d111da37bad tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.085s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.858s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:41:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:41:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=25.323040008544922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8999f490-1fc8-443a-bfaa-6a580681f2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c2e39968-f46d-443d-a7af-f60dd087e905 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9998d4b6-af1d-4e96-8bf5-6038a90f8043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:41:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:41:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:41:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:41:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:41:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:41:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:41:15 user nova-compute[74075]: INFO nova.compute.manager [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] instance snapshotting
Oct 26 09:41:15 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Beginning live snapshot process
Oct 26 09:41:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyuf2s42p/bbe9bb045ce041689ba6ddb88a11c9d2.delta 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyuf2s42p/bbe9bb045ce041689ba6ddb88a11c9d2.delta 1073741824" returned: 0 in 0.056s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:16 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 09:41:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:41:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:41:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 09:41:17 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:41:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyuf2s42p/bbe9bb045ce041689ba6ddb88a11c9d2.delta /opt/stack/data/nova/instances/snapshots/tmpyuf2s42p/bbe9bb045ce041689ba6ddb88a11c9d2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyuf2s42p/bbe9bb045ce041689ba6ddb88a11c9d2.delta /opt/stack/data/nova/instances/snapshots/tmpyuf2s42p/bbe9bb045ce041689ba6ddb88a11c9d2" returned: 0 in 0.544s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:18 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Snapshot extracted, beginning image upload
Oct 26 09:41:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Snapshot image upload complete
Oct 26 09:41:20 user nova-compute[74075]: INFO nova.compute.manager [None req-a495096c-76be-4c03-925d-44bc3bb94edc tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Took 5.58 seconds to snapshot the instance on the hypervisor.
Oct 26 09:41:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-changed-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Refreshing instance network info cache due to event network-changed-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:41:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] Acquiring lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:41:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] Acquired lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:41:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Refreshing network info cache for port ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:41:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updated VIF entry in instance network info cache for port ecd03ba6-ea12-46a5-8e16-4328b52bc0fa. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:41:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updating instance_info_cache with network_info: [{"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c220923f-9352-49b4-a28a-df0321c202fd req-9f7baf24-4a87-4e17-9d9f-8ad97edcf6fc service nova] Releasing lock "refresh_cache-c2e39968-f46d-443d-a7af-f60dd087e905" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:32 user nova-compute[74075]: INFO nova.compute.manager [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Terminating instance
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-8d3096cf-8daf-48ca-a7b7-1f4f39c8570b req-d6881989-77d3-4af4-b592-8f7c6fccc2cd service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-unplugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8d3096cf-8daf-48ca-a7b7-1f4f39c8570b req-d6881989-77d3-4af4-b592-8f7c6fccc2cd service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8d3096cf-8daf-48ca-a7b7-1f4f39c8570b req-d6881989-77d3-4af4-b592-8f7c6fccc2cd service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8d3096cf-8daf-48ca-a7b7-1f4f39c8570b req-d6881989-77d3-4af4-b592-8f7c6fccc2cd service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-8d3096cf-8daf-48ca-a7b7-1f4f39c8570b req-d6881989-77d3-4af4-b592-8f7c6fccc2cd service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-unplugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-8d3096cf-8daf-48ca-a7b7-1f4f39c8570b req-d6881989-77d3-4af4-b592-8f7c6fccc2cd service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-unplugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:41:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Instance destroyed successfully.
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.objects.instance [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'resources' on Instance uuid 1d69c28a-91cb-47b3-b58d-0391ff8029c6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1030772267',display_name='tempest-ServerActionsTestOtherA-server-1616214022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1030772267',id=22,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY6XdemNGi/T5Swi6Qm1B3fJox8HXNlq/nDs38Q27usMWgV6OUZP35al+1l4dDaFCJXgrAfYAtM6lOZpqFR1UMG4mroKlQSfHltwkjm/4M85S8xOTkY77/EIN1bmQdtJw==',key_name='tempest-keypair-145721028',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-ei5ackcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=1d69c28a-91cb-47b3-b58d-0391ff8029c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "address": "fa:16:3e:00:07:6b", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46466255-14", "ovs_interfaceid": "46466255-14c7-44ca-a9f2-ba113a2f6c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG os_vif [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46466255-14, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98e2782f-af9a-43c7-b21e-11e0ed0287cb) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:32 user nova-compute[74075]: INFO os_vif [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:07:6b,bridge_name='br-int',has_traffic_filtering=True,id=46466255-14c7-44ca-a9f2-ba113a2f6c7b,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46466255-14')
Oct 26 09:41:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Deleting instance files /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6_del
Oct 26 09:41:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Deletion of /opt/stack/data/nova/instances/1d69c28a-91cb-47b3-b58d-0391ff8029c6_del complete
Oct 26 09:41:32 user nova-compute[74075]: INFO nova.compute.manager [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 09:41:32 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:41:32 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:41:33 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:41:33 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:33 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Took 0.77 seconds to deallocate network for instance.
Oct 26 09:41:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-e449113a-3304-4f19-a085-d185b8db293a req-f11f8f7b-7015-4f45-963a-c145c77ff496 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-deleted-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:33 user nova-compute[74075]: INFO nova.compute.manager [req-e449113a-3304-4f19-a085-d185b8db293a req-f11f8f7b-7015-4f45-963a-c145c77ff496 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Neutron deleted interface 46466255-14c7-44ca-a9f2-ba113a2f6c7b; detaching it from the instance and deleting it from the info cache
Oct 26 09:41:33 user nova-compute[74075]: DEBUG nova.network.neutron [req-e449113a-3304-4f19-a085-d185b8db293a req-f11f8f7b-7015-4f45-963a-c145c77ff496 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-e449113a-3304-4f19-a085-d185b8db293a req-f11f8f7b-7015-4f45-963a-c145c77ff496 service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Detach interface failed, port_id=46466255-14c7-44ca-a9f2-ba113a2f6c7b, reason: Instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:41:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:34 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Deleted allocations for instance 1d69c28a-91cb-47b3-b58d-0391ff8029c6
Oct 26 09:41:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-48c1d564-3514-44c2-8709-2d6773cb26c8 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-04fd16c9-b1e9-4c20-a557-07f355b2c7ac req-196c23ab-ae9a-473f-8808-95789039e0cf service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-04fd16c9-b1e9-4c20-a557-07f355b2c7ac req-196c23ab-ae9a-473f-8808-95789039e0cf service nova] Acquiring lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-04fd16c9-b1e9-4c20-a557-07f355b2c7ac req-196c23ab-ae9a-473f-8808-95789039e0cf service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-04fd16c9-b1e9-4c20-a557-07f355b2c7ac req-196c23ab-ae9a-473f-8808-95789039e0cf service nova] Lock "1d69c28a-91cb-47b3-b58d-0391ff8029c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-04fd16c9-b1e9-4c20-a557-07f355b2c7ac req-196c23ab-ae9a-473f-8808-95789039e0cf service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] No waiting events found dispatching network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:34 user nova-compute[74075]: WARNING nova.compute.manager [req-04fd16c9-b1e9-4c20-a557-07f355b2c7ac req-196c23ab-ae9a-473f-8808-95789039e0cf service nova] [instance: 1d69c28a-91cb-47b3-b58d-0391ff8029c6] Received unexpected event network-vif-plugged-46466255-14c7-44ca-a9f2-ba113a2f6c7b for instance with vm_state deleted and task_state None.
Oct 26 09:41:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:37 user nova-compute[74075]: DEBUG nova.objects.instance [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:38 user nova-compute[74075]: INFO nova.compute.manager [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Attaching volume f4edc366-76db-4c0c-a52c-3f8039ff6c38 to /dev/vdb
Oct 26 09:41:38 user nova-compute[74075]: DEBUG os_brick.utils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5529fab5-95e3-4ce8-9eac-a8c0e92697bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21c4db7-a0ce-4ebc-b7f2-8a66c432f43c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782ab30-cde4-4ba5-85c2-37c2c7553f33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b800dba9-7e59-4843-8a1f-44a99cbc4cb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:41:38 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:41:38 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[463be653-623f-4263-a8cb-7b69d05420a5]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG os_brick.utils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:41:38 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updating existing volume attachment record: 7cee872d-b362-457a-8b8a-77283fae484c {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:41:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:41:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:41:43 user nova-compute[74075]: INFO nova.compute.claims [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Claim successful on node user
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:41:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.policy [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe323ea95a554c1cbb5d689cbe32a993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f136d23306b64c14a4d7433fbcc1ce47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:41:44 user nova-compute[74075]: INFO nova.virt.block_device [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Booting with volume fc4e9783-ce94-43d1-b719-fff64f2b4b99 at /dev/vda
Oct 26 09:41:44 user nova-compute[74075]: DEBUG os_brick.utils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5166a15d-07ea-41dd-baab-7ec399cc83c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea19aca-fa5e-4ac3-8ccc-9636ac09712b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12cc8c9-cd04-454c-a342-87fb93bbee03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d515a-ba53-48ed-b521-95217772c325]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:41:44 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:41:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d11f1-542e-471e-b637-758c990bdeef]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG os_brick.utils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:41:44 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updating existing volume attachment record: 207067b3-2341-4ee6-bf4f-e938924c09e5 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Successfully created port: 9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:45 user nova-compute[74075]: INFO nova.compute.manager [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Terminating instance
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-a10d470c-588e-4dc1-b948-eff66b210fef req-95f86041-7801-4a99-8929-d980b9fdf601 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a10d470c-588e-4dc1-b948-eff66b210fef req-95f86041-7801-4a99-8929-d980b9fdf601 service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a10d470c-588e-4dc1-b948-eff66b210fef req-95f86041-7801-4a99-8929-d980b9fdf601 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a10d470c-588e-4dc1-b948-eff66b210fef req-95f86041-7801-4a99-8929-d980b9fdf601 service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-a10d470c-588e-4dc1-b948-eff66b210fef req-95f86041-7801-4a99-8929-d980b9fdf601 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-a10d470c-588e-4dc1-b948-eff66b210fef req-95f86041-7801-4a99-8929-d980b9fdf601 service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Instance destroyed successfully.
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.objects.instance [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lazy-loading 'resources' on Instance uuid 8999f490-1fc8-443a-bfaa-6a580681f2b8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1620232250',display_name='tempest-ServerRescueNegativeTestJSON-server-1620232250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1620232250',id=1,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e453d88800e642b98d9b66dde5fe2e73',ramdisk_id='',reservation_id='r-0iyo9h64',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-336149992',owner_user_name='tempest-ServerRescueNegativeTestJSON-336149992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:30:57Z,user_data=None,user_id='82d86b9184a1410db33192820885da0f',uuid=8999f490-1fc8-443a-bfaa-6a580681f2b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converting VIF {"id": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "address": "fa:16:3e:24:18:70", "network": {"id": "f09dc72e-75bf-4319-90ad-553799d77bd7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1342763269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e453d88800e642b98d9b66dde5fe2e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73df641-2c", "ovs_interfaceid": "a73df641-2c14-4ee8-b7fb-f0e08c11a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG os_vif [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73df641-2c, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c45aef73-81e1-4cc4-acb4-cdc694db33a1) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:41:45 user nova-compute[74075]: INFO os_vif [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:18:70,bridge_name='br-int',has_traffic_filtering=True,id=a73df641-2c14-4ee8-b7fb-f0e08c11a445,network=Network(f09dc72e-75bf-4319-90ad-553799d77bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73df641-2c')
Oct 26 09:41:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Deleting instance files /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8_del
Oct 26 09:41:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Deletion of /opt/stack/data/nova/instances/8999f490-1fc8-443a-bfaa-6a580681f2b8_del complete
Oct 26 09:41:46 user nova-compute[74075]: INFO nova.compute.manager [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Successfully updated port: 9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquired lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-changed-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Refreshing instance network info cache due to event network-changed-9e121e6c-a896-4eea-81ea-c2a22a7fbec1. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] Acquiring lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updating instance_info_cache with network_info: [{"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Releasing lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance network_info: |[{"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] Acquired lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Refreshing network info cache for port 9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updated VIF entry in instance network info cache for port 9e121e6c-a896-4eea-81ea-c2a22a7fbec1. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updating instance_info_cache with network_info: [{"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03ef59b6-dcae-4ecc-ac82-e2e7dd9a56fe req-3820dd0d-d074-4eb6-bc26-a37eae775282 service nova] Releasing lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:41:46 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Took 0.90 seconds to deallocate network for instance.
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Deleted allocations for instance 8999f490-1fc8-443a-bfaa-6a580681f2b8
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-871a0fa3-9e06-4c46-bec4-0a3889a593b0 tempest-ServerRescueNegativeTestJSON-336149992 tempest-ServerRescueNegativeTestJSON-336149992-project-member] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:47 user nova-compute[74075]: WARNING nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state deleted and task_state None.
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:47 user nova-compute[74075]: WARNING nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state deleted and task_state None.
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:47 user nova-compute[74075]: WARNING nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state deleted and task_state None.
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:47 user nova-compute[74075]: WARNING nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-unplugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state deleted and task_state None.
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Acquiring lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] Lock "8999f490-1fc8-443a-bfaa-6a580681f2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] No waiting events found dispatching network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:41:47 user nova-compute[74075]: WARNING nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received unexpected event network-vif-plugged-a73df641-2c14-4ee8-b7fb-f0e08c11a445 for instance with vm_state deleted and task_state None.
Oct 26 09:41:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24f47314-0d34-4c73-967b-de967e9c6cd9 req-5a0747ee-5024-4a69-b320-6fb1d955b0ac service nova] [instance: 8999f490-1fc8-443a-bfaa-6a580681f2b8] Received event network-vif-deleted-a73df641-2c14-4ee8-b7fb-f0e08c11a445 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:41:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:41:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:41:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:42:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:42:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=25.313735961914062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c2e39968-f46d-443d-a7af-f60dd087e905 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9998d4b6-af1d-4e96-8bf5-6038a90f8043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:42:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Creating image(s)
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Ensure instance console log exists: /opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Start _get_guest_xml network_info=[{"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '207067b3-2341-4ee6-bf4f-e938924c09e5', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'serial': 'fc4e9783-ce94-43d1-b719-fff64f2b4b99'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:42:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:42:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:42:04 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:42:04 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:42:04 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:42:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46e1c22-8212-4d5d-a585-faaf08ef0b85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:42:04 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09a908-540f-44cf-9b26-b86c3bb2ba2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99] added
Oct 26 09:42:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[502ad9a5-b196-49cb-b6a1-b971b3f105c0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bfaa97-374e-4d18-9c6a-6cc7f31e573e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMySXkFe {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMySXkFe" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637bc2e-3906-4fec-ac2a-33ab06fc5c61]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMySXkFe'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef881e-402e-48ab-8037-d1872d446c29]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf8079-1c39-4108-80ba-a596153d3464]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea050da-852e-4e5f-a832-227ae53063d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]
Oct 26 09:42:04 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.
Oct 26 09:42:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[37753ac8-a299-4edf-8221-34e470b24194]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b7f53-3462-4fbb-a052-837a00684109]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:04 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:04 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405f19d-8575-4c36-9763-1889dfb6b95c]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26630366431303865', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630366431303865', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1300777303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300777303',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcZZIk2zkIUHPsS9BD3ltrXs4U9SqHpluFWoqb38Y95MCbCzTgDQkxmAk8sPH3FUSm5DJiVkedmeVlU3VVlSSY/szljLnpPnKTnzG0bacZSENTaw60o5HK5qMlAK72tGg==',key_name='tempest-keypair-1526605894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f136d23306b64c14a4d7433fbcc1ce47',ramdisk_id='',reservation_id='r-dirbl4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1238912120',owner_user_name='tempest-ServerActionsV293TestJSON-1238912120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe323ea95a554c1cbb5d689cbe32a993',uuid=d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converting VIF {"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lazy-loading 'pci_devices' on Instance uuid d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:42:05 user nova-compute[74075]:   <uuid>d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e</uuid>
Oct 26 09:42:05 user nova-compute[74075]:   <name>instance-0000001e</name>
Oct 26 09:42:05 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:42:05 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:42:05 user nova-compute[74075]:   <metadata>
Oct 26 09:42:05 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:42:05 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:42:05 user nova-compute[74075]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1300777303</nova:name>
Oct 26 09:42:05 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:42:04</nova:creationTime>
Oct 26 09:42:05 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:42:05 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:42:05 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:42:05 user nova-compute[74075]:       <nova:owner>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:user uuid="fe323ea95a554c1cbb5d689cbe32a993">tempest-ServerActionsV293TestJSON-1238912120-project-member</nova:user>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:project uuid="f136d23306b64c14a4d7433fbcc1ce47">tempest-ServerActionsV293TestJSON-1238912120</nova:project>
Oct 26 09:42:05 user nova-compute[74075]:       </nova:owner>
Oct 26 09:42:05 user nova-compute[74075]:       <nova:ports>
Oct 26 09:42:05 user nova-compute[74075]:         <nova:port uuid="9e121e6c-a896-4eea-81ea-c2a22a7fbec1">
Oct 26 09:42:05 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 09:42:05 user nova-compute[74075]:         </nova:port>
Oct 26 09:42:05 user nova-compute[74075]:       </nova:ports>
Oct 26 09:42:05 user nova-compute[74075]:     </nova:instance>
Oct 26 09:42:05 user nova-compute[74075]:   </metadata>
Oct 26 09:42:05 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:42:05 user nova-compute[74075]:     <system>
Oct 26 09:42:05 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:42:05 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:42:05 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:42:05 user nova-compute[74075]:       <entry name="serial">d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e</entry>
Oct 26 09:42:05 user nova-compute[74075]:       <entry name="uuid">d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e</entry>
Oct 26 09:42:05 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:42:05 user nova-compute[74075]:     </system>
Oct 26 09:42:05 user nova-compute[74075]:   </sysinfo>
Oct 26 09:42:05 user nova-compute[74075]:   <os>
Oct 26 09:42:05 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:42:05 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:42:05 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:42:05 user nova-compute[74075]:   </os>
Oct 26 09:42:05 user nova-compute[74075]:   <features>
Oct 26 09:42:05 user nova-compute[74075]:     <acpi/>
Oct 26 09:42:05 user nova-compute[74075]:     <apic/>
Oct 26 09:42:05 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:42:05 user nova-compute[74075]:   </features>
Oct 26 09:42:05 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:42:05 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:42:05 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:42:05 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:42:05 user nova-compute[74075]:   </clock>
Oct 26 09:42:05 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:42:05 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:42:05 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:42:05 user nova-compute[74075]:   </cpu>
Oct 26 09:42:05 user nova-compute[74075]:   <devices>
Oct 26 09:42:05 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:42:05 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:42:05 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:42:05 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:42:05 user nova-compute[74075]:       <serial>fc4e9783-ce94-43d1-b719-fff64f2b4b99</serial>
Oct 26 09:42:05 user nova-compute[74075]:     </disk>
Oct 26 09:42:05 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:42:05 user nova-compute[74075]:       <mac address="fa:16:3e:6e:de:ad"/>
Oct 26 09:42:05 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:42:05 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:42:05 user nova-compute[74075]:       <target dev="tap9e121e6c-a8"/>
Oct 26 09:42:05 user nova-compute[74075]:     </interface>
Oct 26 09:42:05 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:42:05 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e/console.log" append="off"/>
Oct 26 09:42:05 user nova-compute[74075]:     </serial>
Oct 26 09:42:05 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:42:05 user nova-compute[74075]:     <video>
Oct 26 09:42:05 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:42:05 user nova-compute[74075]:     </video>
Oct 26 09:42:05 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:42:05 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:42:05 user nova-compute[74075]:     </rng>
Oct 26 09:42:05 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:42:05 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:42:05 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:42:05 user nova-compute[74075]:     </memballoon>
Oct 26 09:42:05 user nova-compute[74075]:   </devices>
Oct 26 09:42:05 user nova-compute[74075]: </domain>
Oct 26 09:42:05 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1300777303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300777303',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcZZIk2zkIUHPsS9BD3ltrXs4U9SqHpluFWoqb38Y95MCbCzTgDQkxmAk8sPH3FUSm5DJiVkedmeVlU3VVlSSY/szljLnpPnKTnzG0bacZSENTaw60o5HK5qMlAK72tGg==',key_name='tempest-keypair-1526605894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f136d23306b64c14a4d7433fbcc1ce47',ramdisk_id='',reservation_id='r-dirbl4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1238912120',owner_user_name='tempest-ServerActionsV293TestJSON-1238912120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe323ea95a554c1cbb5d689cbe32a993',uuid=d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converting VIF {"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG os_vif [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd4e196f-32d2-530c-9fa5-2842a04c9264', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e121e6c-a8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e121e6c-a8, col_values=(('qos', UUID('5f231037-3d6a-4133-89f1-8744f1cd7554')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e121e6c-a8, col_values=(('external_ids', {'iface-id': '9e121e6c-a896-4eea-81ea-c2a22a7fbec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:de:ad', 'vm-uuid': 'd6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:05 user nova-compute[74075]: INFO os_vif [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8')
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:42:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] No VIF found with MAC fa:16:3e:6e:de:ad, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:42:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3d86165-ab16-4525-817d-e8ea58643d99 req-e10b27f3-b565-4488-906a-84e75f7356d0 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3d86165-ab16-4525-817d-e8ea58643d99 req-e10b27f3-b565-4488-906a-84e75f7356d0 service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3d86165-ab16-4525-817d-e8ea58643d99 req-e10b27f3-b565-4488-906a-84e75f7356d0 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3d86165-ab16-4525-817d-e8ea58643d99 req-e10b27f3-b565-4488-906a-84e75f7356d0 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3d86165-ab16-4525-817d-e8ea58643d99 req-e10b27f3-b565-4488-906a-84e75f7356d0 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:42:07 user nova-compute[74075]: WARNING nova.compute.manager [req-f3d86165-ab16-4525-817d-e8ea58643d99 req-e10b27f3-b565-4488-906a-84e75f7356d0 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state building and task_state spawning.
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:42:09 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance spawned successfully.
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:09 user nova-compute[74075]: INFO nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Took 5.09 seconds to spawn the instance on the hypervisor.
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:42:09 user nova-compute[74075]: INFO nova.compute.manager [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Took 25.79 seconds to build instance.
Oct 26 09:42:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dafee1d2-82ea-474a-91ba-9127b694470c tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.892s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-d9d7e35d-f56b-4337-aefd-6ed9c5d49ab5 req-f3ab47e9-2e13-4d35-80e0-02d436bf1dad service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9d7e35d-f56b-4337-aefd-6ed9c5d49ab5 req-f3ab47e9-2e13-4d35-80e0-02d436bf1dad service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9d7e35d-f56b-4337-aefd-6ed9c5d49ab5 req-f3ab47e9-2e13-4d35-80e0-02d436bf1dad service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d9d7e35d-f56b-4337-aefd-6ed9c5d49ab5 req-f3ab47e9-2e13-4d35-80e0-02d436bf1dad service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-d9d7e35d-f56b-4337-aefd-6ed9c5d49ab5 req-f3ab47e9-2e13-4d35-80e0-02d436bf1dad service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:42:09 user nova-compute[74075]: WARNING nova.compute.manager [req-d9d7e35d-f56b-4337-aefd-6ed9c5d49ab5 req-f3ab47e9-2e13-4d35-80e0-02d436bf1dad service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state active and task_state None.
Oct 26 09:42:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNARGaFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:42:19 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:42:19 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:42:19 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaf56d4-cfdc-4258-8a87-556871e3abca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:42:19 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bb74b4-7000-41cb-8bd6-8f98e189574a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38] added
Oct 26 09:42:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[607297b8-3551-4ebb-a662-5101a61c09d1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19958f-3973-4272-b7a2-192ae5298c4c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lNARGaFQ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lNARGaFQ" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3571c5a-bc7c-4f1d-8d74-07e982ed678a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lNARGaFQ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01949a2-3b86-46cc-a307-a190c5419232]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b25eb81-903a-47e3-a716-6a10a2a3d735]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8145dd9e-59aa-4176-86a4-12afb76effda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260]
Oct 26 09:42:20 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260] successful.
Oct 26 09:42:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[80beff0f-8e9c-4e52-ae80-e1b84e7410aa]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf28153f-b707-4587-84db-99b08b0d7393]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 (non-flash)
Oct 26 09:42:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf535d-59b9-477e-8cb4-d5754d8f0339]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNARGaFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:42:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26662633336653036', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662633336653036', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:42:21 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:42:21 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:42:21 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:42:21 user nova-compute[74075]:   <serial>f4edc366-76db-4c0c-a52c-3f8039ff6c38</serial>
Oct 26 09:42:21 user nova-compute[74075]: </disk>
Oct 26 09:42:21 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:a7:f6:b4, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:42:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49c67975-356e-4479-8216-a30397f271c4 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.685s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:23 user nova-compute[74075]: INFO nova.compute.manager [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Detaching volume f4edc366-76db-4c0c-a52c-3f8039ff6c38
Oct 26 09:42:23 user nova-compute[74075]: INFO nova.virt.block_device [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Attempting to driver detach volume f4edc366-76db-4c0c-a52c-3f8039ff6c38 from mountpoint /dev/vdb
Oct 26 09:42:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Attempting to detach device vdb from instance c2e39968-f46d-443d-a7af-f60dd087e905 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:42:23 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:42:23 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:42:23 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:42:23 user nova-compute[74075]:   <serial>f4edc366-76db-4c0c-a52c-3f8039ff6c38</serial>
Oct 26 09:42:23 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:42:23 user nova-compute[74075]: </disk>
Oct 26 09:42:23 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:42:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully detached device vdb from instance c2e39968-f46d-443d-a7af-f60dd087e905 from the persistent domain config.
Oct 26 09:42:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2e39968-f46d-443d-a7af-f60dd087e905 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:42:23 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:42:23 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:42:23 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:42:23 user nova-compute[74075]:   <serial>f4edc366-76db-4c0c-a52c-3f8039ff6c38</serial>
Oct 26 09:42:23 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:42:23 user nova-compute[74075]: </disk>
Oct 26 09:42:23 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:42:24 user nova-compute[74075]: INFO nova.compute.claims [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Claim successful on node user
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:42:24 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:42:24 user nova-compute[74075]: INFO nova.virt.block_device [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Booting with volume-backed-image dfb66725-6124-42bd-9a80-fc5728283531 at /dev/vda
Oct 26 09:42:24 user nova-compute[74075]: DEBUG nova.policy [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05e6ea9a6e248e892fb237a31d4b1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf8f091fdd04a9c8e5b14632402efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:42:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Successfully created port: e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:42:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Successfully updated port: e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:42:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:42:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:42:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-changed-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Refreshing instance network info cache due to event network-changed-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] Acquiring lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updating instance_info_cache with network_info: [{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance network_info: |[{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] Acquired lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:42:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Refreshing network info cache for port e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG nova.network.neutron [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updated VIF entry in instance network info cache for port e5592cbe-13c0-48ad-8f2b-16ff8e70e46e. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG nova.network.neutron [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updating instance_info_cache with network_info: [{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-26cdfbd5-41fc-4bd8-a0cb-10ca74b5c71b req-6826b89b-8ba6-4cbd-b411-541182cbdf31 service nova] Releasing lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:27 user nova-compute[74075]: INFO nova.compute.manager [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Terminating instance
Oct 26 09:42:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Instance destroyed successfully.
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lazy-loading 'resources' on Instance uuid 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-921691787',display_name='tempest-VolumesNegativeTest-instance-921691787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-921691787',id=28,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e90542bf6a4a4622a6b37f1fd0e46b73',ramdisk_id='',reservation_id='r-h07pr34k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1243883127',owner_user_name='tempest-VolumesNegativeTest-1243883127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:40:46Z,user_data=None,user_id='a6bab0fb35654e769202e040661997a8',uuid=95203f61-c0f4-4fc0-a13c-cf8d11ba32e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Converting VIF {"id": "a73c71ef-6de4-4732-a7a2-e54082148980", "address": "fa:16:3e:aa:44:e2", "network": {"id": "d62a42c1-d3e0-40b3-8fd3-294c75b54f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1adb3b3dba104f3b992ef1a35bc02ec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73c71ef-6d", "ovs_interfaceid": "a73c71ef-6de4-4732-a7a2-e54082148980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG os_vif [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73c71ef-6d, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89168f0d-93a1-4abb-8a5c-36b317f557c2) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:28 user nova-compute[74075]: INFO os_vif [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:44:e2,bridge_name='br-int',has_traffic_filtering=True,id=a73c71ef-6de4-4732-a7a2-e54082148980,network=Network(d62a42c1-d3e0-40b3-8fd3-294c75b54f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73c71ef-6d')
Oct 26 09:42:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Deleting instance files /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7_del
Oct 26 09:42:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Deletion of /opt/stack/data/nova/instances/95203f61-c0f4-4fc0-a13c-cf8d11ba32e7_del complete
Oct 26 09:42:28 user nova-compute[74075]: INFO nova.compute.manager [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 26 09:42:28 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-596abd90-54a0-4106-bb89-2f8083ca9fc9 req-0d215ca1-52d5-4c10-857e-e042335cb6bd service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-vif-unplugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-596abd90-54a0-4106-bb89-2f8083ca9fc9 req-0d215ca1-52d5-4c10-857e-e042335cb6bd service nova] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-596abd90-54a0-4106-bb89-2f8083ca9fc9 req-0d215ca1-52d5-4c10-857e-e042335cb6bd service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-596abd90-54a0-4106-bb89-2f8083ca9fc9 req-0d215ca1-52d5-4c10-857e-e042335cb6bd service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-596abd90-54a0-4106-bb89-2f8083ca9fc9 req-0d215ca1-52d5-4c10-857e-e042335cb6bd service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] No waiting events found dispatching network-vif-unplugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-596abd90-54a0-4106-bb89-2f8083ca9fc9 req-0d215ca1-52d5-4c10-857e-e042335cb6bd service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-vif-unplugged-a73c71ef-6de4-4732-a7a2-e54082148980 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:42:28 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:28 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Took 0.55 seconds to deallocate network for instance.
Oct 26 09:42:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:29 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:42:29 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:42:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:29 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Deleted allocations for instance 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7
Oct 26 09:42:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f82d9927-36fd-436f-90d4-ebea692eed67 tempest-VolumesNegativeTest-1243883127 tempest-VolumesNegativeTest-1243883127-project-member] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] Acquiring lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] Lock "95203f61-c0f4-4fc0-a13c-cf8d11ba32e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] No waiting events found dispatching network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:42:30 user nova-compute[74075]: WARNING nova.compute.manager [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received unexpected event network-vif-plugged-a73c71ef-6de4-4732-a7a2-e54082148980 for instance with vm_state deleted and task_state None.
Oct 26 09:42:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-b7d348de-814b-4daa-91b3-c0b77953d10f req-59d3d7c5-096e-41c6-b6ae-1fb63c0378cc service nova] [instance: 95203f61-c0f4-4fc0-a13c-cf8d11ba32e7] Received event network-vif-deleted-a73c71ef-6de4-4732-a7a2-e54082148980 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:30 user nova-compute[74075]: INFO nova.compute.manager [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Terminating instance
Oct 26 09:42:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Instance destroyed successfully.
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.objects.instance [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lazy-loading 'resources' on Instance uuid 9998d4b6-af1d-4e96-8bf5-6038a90f8043 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-450323532',display_name='tempest-VolumesActionsTest-instance-450323532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-450323532',id=29,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2c735fb27274a10a4005325bc5d9e4c',ramdisk_id='',reservation_id='r-h2g2k84p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1450383175',owner_user_name='tempest-VolumesActionsTest-1450383175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:40:47Z,user_data=None,user_id='701652cea9c342469f8b4bed5c3b89c1',uuid=9998d4b6-af1d-4e96-8bf5-6038a90f8043,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converting VIF {"id": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "address": "fa:16:3e:ab:f0:a9", "network": {"id": "d082f47a-fded-4d78-86b3-f4afa782c738", "bridge": "br-int", "label": "tempest-VolumesActionsTest-650198636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2c735fb27274a10a4005325bc5d9e4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8a0f5-13", "ovs_interfaceid": "a0b8a0f5-136c-4b57-8488-c75f67eb1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG os_vif [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0b8a0f5-13, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46667d69-6bdb-4e2b-8040-686933c1a528) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:31 user nova-compute[74075]: INFO os_vif [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a0b8a0f5-136c-4b57-8488-c75f67eb1e4f,network=Network(d082f47a-fded-4d78-86b3-f4afa782c738),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8a0f5-13')
Oct 26 09:42:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Deleting instance files /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043_del
Oct 26 09:42:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Deletion of /opt/stack/data/nova/instances/9998d4b6-af1d-4e96-8bf5-6038a90f8043_del complete
Oct 26 09:42:31 user nova-compute[74075]: INFO nova.compute.manager [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 09:42:31 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:42:31 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:31 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Took 0.49 seconds to deallocate network for instance.
Oct 26 09:42:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:32 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Deleted allocations for instance 9998d4b6-af1d-4e96-8bf5-6038a90f8043
Oct 26 09:42:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-15b335b0-f5f3-4bed-b1ad-8999d9425c36 tempest-VolumesActionsTest-1450383175 tempest-VolumesActionsTest-1450383175-project-member] Lock "9998d4b6-af1d-4e96-8bf5-6038a90f8043" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.929s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-0458ab19-8889-40f7-91c0-f6250ee67606 req-cbce4fbc-ae67-440a-bbc8-4e75d4f53802 service nova] [instance: 9998d4b6-af1d-4e96-8bf5-6038a90f8043] Received event network-vif-deleted-a0b8a0f5-136c-4b57-8488-c75f67eb1e4f {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG os_brick.utils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[41642139-4875-4342-8f16-582463cb55fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcaf19c-bfe0-4892-9449-9abd1e1d7c59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a6def-45ea-4c94-9385-72a1d73cbfcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[00039d12-220f-49aa-bfca-fcf9acba79da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:42:40 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca44ee-b922-4d06-aa80-4acbb0db4686]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG os_brick.utils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updating existing volume attachment record: a65022eb-1c4a-41d1-b28b-f401f0b7370c {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:42:40 user nova-compute[74075]: INFO nova.compute.claims [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Claim successful on node user
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:42:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.policy [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25a0123b730f4a6d9b8e6bf15fd5727b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4dadbf57244875abb469e5bf240471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:42:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Creating image(s)
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "/opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "/opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk 1073741824" returned: 0 in 0.064s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Successfully created port: 3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Cannot resize image /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Ensure instance console log exists: /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Successfully updated port: 3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquired lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-changed-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Refreshing instance network info cache due to event network-changed-3ac366dd-deee-4116-bc3c-a22a05450676. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] Acquiring lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updating instance_info_cache with network_info: [{"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Releasing lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Instance network_info: |[{"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] Acquired lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:42:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Refreshing network info cache for port 3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Start _get_guest_xml network_info=[{"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:42:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:42:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3050784',id=32,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiAxj8HILZoj9TzxOBDO8aLSJSlFTDO38Wje36X8U+dnJ8OeaXZQZYgVtWf1qzSXS6OUr1WOFEHUzWzS5UiA4DxIdRauWua4zzvGX9ZZpbnj3U2pzc442mBzdxrC2ByHQ==',key_name='tempest-keypair-2121053291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db4dadbf57244875abb469e5bf240471',ramdisk_id='',reservation_id='r-5zk0tg83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-368946537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25a0123b730f4a6d9b8e6bf15fd5727b',uuid=b1e64231-fb6b-40d8-8edf-f91e6993f2da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Converting VIF {"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lazy-loading 'pci_devices' on Instance uuid b1e64231-fb6b-40d8-8edf-f91e6993f2da {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:42:43 user nova-compute[74075]:   <uuid>b1e64231-fb6b-40d8-8edf-f91e6993f2da</uuid>
Oct 26 09:42:43 user nova-compute[74075]:   <name>instance-00000020</name>
Oct 26 09:42:43 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:42:43 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:42:43 user nova-compute[74075]:   <metadata>
Oct 26 09:42:43 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:42:43 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:42:43 user nova-compute[74075]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431</nova:name>
Oct 26 09:42:43 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:42:43</nova:creationTime>
Oct 26 09:42:43 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:42:43 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:42:43 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:42:43 user nova-compute[74075]:       <nova:owner>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:user uuid="25a0123b730f4a6d9b8e6bf15fd5727b">tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member</nova:user>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:project uuid="db4dadbf57244875abb469e5bf240471">tempest-TestServerVolumeAttachScenarioOldVersion-368946537</nova:project>
Oct 26 09:42:43 user nova-compute[74075]:       </nova:owner>
Oct 26 09:42:43 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:42:43 user nova-compute[74075]:       <nova:ports>
Oct 26 09:42:43 user nova-compute[74075]:         <nova:port uuid="3ac366dd-deee-4116-bc3c-a22a05450676">
Oct 26 09:42:43 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 09:42:43 user nova-compute[74075]:         </nova:port>
Oct 26 09:42:43 user nova-compute[74075]:       </nova:ports>
Oct 26 09:42:43 user nova-compute[74075]:     </nova:instance>
Oct 26 09:42:43 user nova-compute[74075]:   </metadata>
Oct 26 09:42:43 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:42:43 user nova-compute[74075]:     <system>
Oct 26 09:42:43 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:42:43 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:42:43 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:42:43 user nova-compute[74075]:       <entry name="serial">b1e64231-fb6b-40d8-8edf-f91e6993f2da</entry>
Oct 26 09:42:43 user nova-compute[74075]:       <entry name="uuid">b1e64231-fb6b-40d8-8edf-f91e6993f2da</entry>
Oct 26 09:42:43 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:42:43 user nova-compute[74075]:     </system>
Oct 26 09:42:43 user nova-compute[74075]:   </sysinfo>
Oct 26 09:42:43 user nova-compute[74075]:   <os>
Oct 26 09:42:43 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:42:43 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:42:43 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:42:43 user nova-compute[74075]:   </os>
Oct 26 09:42:43 user nova-compute[74075]:   <features>
Oct 26 09:42:43 user nova-compute[74075]:     <acpi/>
Oct 26 09:42:43 user nova-compute[74075]:     <apic/>
Oct 26 09:42:43 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:42:43 user nova-compute[74075]:   </features>
Oct 26 09:42:43 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:42:43 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:42:43 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:42:43 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:42:43 user nova-compute[74075]:   </clock>
Oct 26 09:42:43 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:42:43 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:42:43 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:42:43 user nova-compute[74075]:   </cpu>
Oct 26 09:42:43 user nova-compute[74075]:   <devices>
Oct 26 09:42:43 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:42:43 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:42:43 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk"/>
Oct 26 09:42:43 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:42:43 user nova-compute[74075]:     </disk>
Oct 26 09:42:43 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:42:43 user nova-compute[74075]:       <mac address="fa:16:3e:7f:3a:38"/>
Oct 26 09:42:43 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:42:43 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:42:43 user nova-compute[74075]:       <target dev="tap3ac366dd-de"/>
Oct 26 09:42:43 user nova-compute[74075]:     </interface>
Oct 26 09:42:43 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:42:43 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/console.log" append="off"/>
Oct 26 09:42:43 user nova-compute[74075]:     </serial>
Oct 26 09:42:43 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:42:43 user nova-compute[74075]:     <video>
Oct 26 09:42:43 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:42:43 user nova-compute[74075]:     </video>
Oct 26 09:42:43 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:42:43 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:42:43 user nova-compute[74075]:     </rng>
Oct 26 09:42:43 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:42:43 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:42:43 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:42:43 user nova-compute[74075]:     </memballoon>
Oct 26 09:42:43 user nova-compute[74075]:   </devices>
Oct 26 09:42:43 user nova-compute[74075]: </domain>
Oct 26 09:42:43 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3050784',id=32,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiAxj8HILZoj9TzxOBDO8aLSJSlFTDO38Wje36X8U+dnJ8OeaXZQZYgVtWf1qzSXS6OUr1WOFEHUzWzS5UiA4DxIdRauWua4zzvGX9ZZpbnj3U2pzc442mBzdxrC2ByHQ==',key_name='tempest-keypair-2121053291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db4dadbf57244875abb469e5bf240471',ramdisk_id='',reservation_id='r-5zk0tg83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-368946537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25a0123b730f4a6d9b8e6bf15fd5727b',uuid=b1e64231-fb6b-40d8-8edf-f91e6993f2da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Converting VIF {"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG os_vif [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7431836-0763-51cb-857f-9f0d4f9d0f3b', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ac366dd-de, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ac366dd-de, col_values=(('qos', UUID('5bfe5ad8-22a4-4ab7-ad07-cd32af5972bb')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ac366dd-de, col_values=(('external_ids', {'iface-id': '3ac366dd-deee-4116-bc3c-a22a05450676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:3a:38', 'vm-uuid': 'b1e64231-fb6b-40d8-8edf-f91e6993f2da'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:43 user nova-compute[74075]: INFO os_vif [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de')
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] No VIF found with MAC fa:16:3e:7f:3a:38, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updated VIF entry in instance network info cache for port 3ac366dd-deee-4116-bc3c-a22a05450676. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updating instance_info_cache with network_info: [{"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:42:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7c82ae43-1429-4fb7-b6c4-8db320727693 req-d0e9cf68-9930-4da2-a718-fda4a53a6ed1 service nova] Releasing lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:42:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c2e39968-f46d-443d-a7af-f60dd087e905 is timed out.
Oct 26 09:42:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully detached device vdb from instance c2e39968-f46d-443d-a7af-f60dd087e905 from the live domain config.
Oct 26 09:42:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNARGaFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:42:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca0a48-b898-4811-8ae1-6506191213b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:42:44 user nova-compute[74075]: No targets found.
Oct 26 09:42:44 user nova-compute[74075]: iSNS:
Oct 26 09:42:44 user nova-compute[74075]: No targets found.
Oct 26 09:42:44 user nova-compute[74075]: STATIC:
Oct 26 09:42:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38
Oct 26 09:42:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:42:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:42:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99
Oct 26 09:42:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:42:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:42:44 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:42:44 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:42:44 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:42:44 user nova-compute[74075]: FIRMWARE:
Oct 26 09:42:44 user nova-compute[74075]: No targets found.
Oct 26 09:42:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:42:44 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:42:44 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[435853f2-cb33-48d6-9582-29b390856ea1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69aa575-10a4-493a-8792-8501d72bf89c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:44 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:44 user nova-compute[74075]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 (non-flash)
Oct 26 09:42:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:42:44 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:42:44 user nova-compute[74075]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 (non-flash)
Oct 26 09:42:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181e978-c222-498a-a116-7e908e2d60d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e4dadf-ad49-46d3-849b-cb2af5f63c9c]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6f0aa-d550-43bf-8f2b-d8518977c143]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3e5b2-427a-4f26-af41-443f4e1b5d55]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653b925-78ff-4273-8144-93dc6c6ed3cb]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.279s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e1ff9-7a8a-41dd-8811-d231c06d9f90]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260]
Oct 26 09:42:44 user nova-compute[74075]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38, portal: 172.16.0.220,3260] successful.
Oct 26 09:42:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4edc366-76db-4c0c-a52c-3f8039ff6c38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a13f9a-8056-4987-9afb-e54d6030095b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.541s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== disconnect_volume: return (542ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-bbbf8b80-0aed-4b11-a578-2da0ac3a2491 req-f38f3574-e4a3-49b0-bea7-449b84ea4112 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bbbf8b80-0aed-4b11-a578-2da0ac3a2491 req-f38f3574-e4a3-49b0-bea7-449b84ea4112 service nova] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bbbf8b80-0aed-4b11-a578-2da0ac3a2491 req-f38f3574-e4a3-49b0-bea7-449b84ea4112 service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bbbf8b80-0aed-4b11-a578-2da0ac3a2491 req-f38f3574-e4a3-49b0-bea7-449b84ea4112 service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-bbbf8b80-0aed-4b11-a578-2da0ac3a2491 req-f38f3574-e4a3-49b0-bea7-449b84ea4112 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] No waiting events found dispatching network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:42:44 user nova-compute[74075]: WARNING nova.compute.manager [req-bbbf8b80-0aed-4b11-a578-2da0ac3a2491 req-f38f3574-e4a3-49b0-bea7-449b84ea4112 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received unexpected event network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 for instance with vm_state building and task_state spawning.
Oct 26 09:42:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:42:46 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Instance spawned successfully.
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-04446a57-942d-4e81-8d86-476fd343dbc2 req-e1d7b005-5dab-4bc3-8f13-1f08b10105b5 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-04446a57-942d-4e81-8d86-476fd343dbc2 req-e1d7b005-5dab-4bc3-8f13-1f08b10105b5 service nova] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-04446a57-942d-4e81-8d86-476fd343dbc2 req-e1d7b005-5dab-4bc3-8f13-1f08b10105b5 service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-04446a57-942d-4e81-8d86-476fd343dbc2 req-e1d7b005-5dab-4bc3-8f13-1f08b10105b5 service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-04446a57-942d-4e81-8d86-476fd343dbc2 req-e1d7b005-5dab-4bc3-8f13-1f08b10105b5 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] No waiting events found dispatching network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:42:46 user nova-compute[74075]: WARNING nova.compute.manager [req-04446a57-942d-4e81-8d86-476fd343dbc2 req-e1d7b005-5dab-4bc3-8f13-1f08b10105b5 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received unexpected event network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 for instance with vm_state building and task_state spawning.
Oct 26 09:42:46 user nova-compute[74075]: INFO nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 26 09:42:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:42:47 user nova-compute[74075]: INFO nova.compute.manager [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Took 6.24 seconds to build instance.
Oct 26 09:42:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4e63a5f1-876b-4e15-9d63-7e13c6c86c97 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:42:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:42:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:43:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-9c3ead47-305f-4423-b984-c169040646bf tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.517s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:43:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Creating image(s)
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Ensure instance console log exists: /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Start _get_guest_xml network_info=[{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'a65022eb-1c4a-41d1-b28b-f401f0b7370c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9266332d-6d4a-4810-ab56-ce5019f74f04', 'attached_at': '', 'detached_at': '', 'volume_id': '55966697-c3de-4a15-9dea-4cc256ed075e', 'serial': '55966697-c3de-4a15-9dea-4cc256ed075e'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:43:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:43:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:43:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:43:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:43:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:43:02 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d395ada9-09d8-4e9f-a7bf-784289cc34b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:43:02 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e18990-1679-4908-9bb3-2641311143f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e] added
Oct 26 09:43:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[413fb3d3-cd80-4d62-8186-0632147fbec9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed9f35e-b412-4fe7-8e2a-0c1ad4fe926f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BaLeXRYp {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BaLeXRYp" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d844c-8a30-4782-a2d9-9db63c7dc533]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BaLeXRYp'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e43503-9460-4bbf-9497-c90b8507adf0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f542b3-107b-446f-9292-db201c33c188]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c12ea-4c10-4b7c-ae90-119f1e1dd761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260]
Oct 26 09:43:02 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260] successful.
Oct 26 09:43:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[321b3f48-280c-4f6d-bce4-141527fabdd6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a3cdc-f7d5-445c-ae32-93b1ff864260]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:43:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:43:02 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:43:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b2197d-3ebe-4e32-8309-e4160c19a4c4]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23962623934333737', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962623934333737', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353160260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353160260',id=31,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-a5zdyaqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:42:25Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=9266332d-6d4a-4810-ab56-ce5019f74f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'pci_devices' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:43:03 user nova-compute[74075]:   <uuid>9266332d-6d4a-4810-ab56-ce5019f74f04</uuid>
Oct 26 09:43:03 user nova-compute[74075]:   <name>instance-0000001f</name>
Oct 26 09:43:03 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:43:03 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:43:03 user nova-compute[74075]:   <metadata>
Oct 26 09:43:03 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:43:03 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:43:03 user nova-compute[74075]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1353160260</nova:name>
Oct 26 09:43:03 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:43:02</nova:creationTime>
Oct 26 09:43:03 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:43:03 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:43:03 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:43:03 user nova-compute[74075]:       <nova:owner>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:user uuid="f05e6ea9a6e248e892fb237a31d4b1a1">tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member</nova:user>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:project uuid="abf8f091fdd04a9c8e5b14632402efae">tempest-ServerBootFromVolumeStableRescueTest-1733320520</nova:project>
Oct 26 09:43:03 user nova-compute[74075]:       </nova:owner>
Oct 26 09:43:03 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:43:03 user nova-compute[74075]:       <nova:ports>
Oct 26 09:43:03 user nova-compute[74075]:         <nova:port uuid="e5592cbe-13c0-48ad-8f2b-16ff8e70e46e">
Oct 26 09:43:03 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 09:43:03 user nova-compute[74075]:         </nova:port>
Oct 26 09:43:03 user nova-compute[74075]:       </nova:ports>
Oct 26 09:43:03 user nova-compute[74075]:     </nova:instance>
Oct 26 09:43:03 user nova-compute[74075]:   </metadata>
Oct 26 09:43:03 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:43:03 user nova-compute[74075]:     <system>
Oct 26 09:43:03 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:43:03 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:43:03 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:43:03 user nova-compute[74075]:       <entry name="serial">9266332d-6d4a-4810-ab56-ce5019f74f04</entry>
Oct 26 09:43:03 user nova-compute[74075]:       <entry name="uuid">9266332d-6d4a-4810-ab56-ce5019f74f04</entry>
Oct 26 09:43:03 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:43:03 user nova-compute[74075]:     </system>
Oct 26 09:43:03 user nova-compute[74075]:   </sysinfo>
Oct 26 09:43:03 user nova-compute[74075]:   <os>
Oct 26 09:43:03 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:43:03 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:43:03 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:43:03 user nova-compute[74075]:   </os>
Oct 26 09:43:03 user nova-compute[74075]:   <features>
Oct 26 09:43:03 user nova-compute[74075]:     <acpi/>
Oct 26 09:43:03 user nova-compute[74075]:     <apic/>
Oct 26 09:43:03 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:43:03 user nova-compute[74075]:   </features>
Oct 26 09:43:03 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:43:03 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:43:03 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:43:03 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:43:03 user nova-compute[74075]:   </clock>
Oct 26 09:43:03 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:43:03 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:43:03 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:43:03 user nova-compute[74075]:   </cpu>
Oct 26 09:43:03 user nova-compute[74075]:   <devices>
Oct 26 09:43:03 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:43:03 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:43:03 user nova-compute[74075]:       <source dev="/dev/sdd"/>
Oct 26 09:43:03 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:43:03 user nova-compute[74075]:       <serial>55966697-c3de-4a15-9dea-4cc256ed075e</serial>
Oct 26 09:43:03 user nova-compute[74075]:     </disk>
Oct 26 09:43:03 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:43:03 user nova-compute[74075]:       <mac address="fa:16:3e:df:88:76"/>
Oct 26 09:43:03 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:43:03 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:43:03 user nova-compute[74075]:       <target dev="tape5592cbe-13"/>
Oct 26 09:43:03 user nova-compute[74075]:     </interface>
Oct 26 09:43:03 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:43:03 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/console.log" append="off"/>
Oct 26 09:43:03 user nova-compute[74075]:     </serial>
Oct 26 09:43:03 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:43:03 user nova-compute[74075]:     <video>
Oct 26 09:43:03 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:43:03 user nova-compute[74075]:     </video>
Oct 26 09:43:03 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:43:03 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:43:03 user nova-compute[74075]:     </rng>
Oct 26 09:43:03 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:43:03 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:43:03 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:43:03 user nova-compute[74075]:     </memballoon>
Oct 26 09:43:03 user nova-compute[74075]:   </devices>
Oct 26 09:43:03 user nova-compute[74075]: </domain>
Oct 26 09:43:03 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353160260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353160260',id=31,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-a5zdyaqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:42:25Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=9266332d-6d4a-4810-ab56-ce5019f74f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG os_vif [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb19adf0-e1ce-5505-a4a0-85ddd004883f', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5592cbe-13, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5592cbe-13, col_values=(('qos', UUID('11275775-a7d8-4c1a-8917-0c5871690ed9')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5592cbe-13, col_values=(('external_ids', {'iface-id': 'e5592cbe-13c0-48ad-8f2b-16ff8e70e46e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:88:76', 'vm-uuid': '9266332d-6d4a-4810-ab56-ce5019f74f04'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:03 user nova-compute[74075]: INFO os_vif [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13')
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No VIF found with MAC fa:16:3e:df:88:76, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:43:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:43:04 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=25.336421966552734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance c2e39968-f46d-443d-a7af-f60dd087e905 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9266332d-6d4a-4810-ab56-ce5019f74f04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b1e64231-fb6b-40d8-8edf-f91e6993f2da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:43:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-51f3c968-2e9c-460f-a56b-f484135d5c09 req-a5c79953-3ff1-4f7e-b592-c67a8f735442 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-51f3c968-2e9c-460f-a56b-f484135d5c09 req-a5c79953-3ff1-4f7e-b592-c67a8f735442 service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-51f3c968-2e9c-460f-a56b-f484135d5c09 req-a5c79953-3ff1-4f7e-b592-c67a8f735442 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-51f3c968-2e9c-460f-a56b-f484135d5c09 req-a5c79953-3ff1-4f7e-b592-c67a8f735442 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-51f3c968-2e9c-460f-a56b-f484135d5c09 req-a5c79953-3ff1-4f7e-b592-c67a8f735442 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:43:05 user nova-compute[74075]: WARNING nova.compute.manager [req-51f3c968-2e9c-460f-a56b-f484135d5c09 req-a5c79953-3ff1-4f7e-b592-c67a8f735442 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state building and task_state spawning.
Oct 26 09:43:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:43:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:43:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:43:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance spawned successfully.
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:43:07 user nova-compute[74075]: INFO nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-40a0416c-7308-4fbd-93fd-2a7a3392531f req-0f0303cd-03e7-425a-8e0e-9d512de674e9 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-40a0416c-7308-4fbd-93fd-2a7a3392531f req-0f0303cd-03e7-425a-8e0e-9d512de674e9 service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-40a0416c-7308-4fbd-93fd-2a7a3392531f req-0f0303cd-03e7-425a-8e0e-9d512de674e9 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-40a0416c-7308-4fbd-93fd-2a7a3392531f req-0f0303cd-03e7-425a-8e0e-9d512de674e9 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-40a0416c-7308-4fbd-93fd-2a7a3392531f req-0f0303cd-03e7-425a-8e0e-9d512de674e9 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:43:07 user nova-compute[74075]: WARNING nova.compute.manager [req-40a0416c-7308-4fbd-93fd-2a7a3392531f req-0f0303cd-03e7-425a-8e0e-9d512de674e9 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state building and task_state spawning.
Oct 26 09:43:07 user nova-compute[74075]: INFO nova.compute.manager [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Took 43.38 seconds to build instance.
Oct 26 09:43:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6bb87dbd-e273-4e61-abb6-3f015dd0dc58 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.499s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:43:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:14 user nova-compute[74075]: INFO nova.compute.manager [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Terminating instance
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-922d7fc4-b308-4ab9-a017-64ea0b428cb6 req-50fe6fce-b2a9-4167-89c9-657a058d7a22 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-vif-unplugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-922d7fc4-b308-4ab9-a017-64ea0b428cb6 req-50fe6fce-b2a9-4167-89c9-657a058d7a22 service nova] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-922d7fc4-b308-4ab9-a017-64ea0b428cb6 req-50fe6fce-b2a9-4167-89c9-657a058d7a22 service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-922d7fc4-b308-4ab9-a017-64ea0b428cb6 req-50fe6fce-b2a9-4167-89c9-657a058d7a22 service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-922d7fc4-b308-4ab9-a017-64ea0b428cb6 req-50fe6fce-b2a9-4167-89c9-657a058d7a22 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] No waiting events found dispatching network-vif-unplugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-922d7fc4-b308-4ab9-a017-64ea0b428cb6 req-50fe6fce-b2a9-4167-89c9-657a058d7a22 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-vif-unplugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:43:14 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Instance destroyed successfully.
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.objects.instance [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'resources' on Instance uuid c2e39968-f46d-443d-a7af-f60dd087e905 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1735452153',display_name='tempest-AttachVolumeNegativeTest-server-1735452153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1735452153',id=27,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFDLIftlo07xdMBcOwDojr5yKaQwU4umgOwuY0HpLXvV+g04mGE2n3VWok4todv1ojiiurvo1NpxiirLe+oAwAClmXdJin7H3GRj8cuxTQt42gfSm+Oj9yhaei9dY9TZQ==',key_name='tempest-keypair-1981167971',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-lmxkb932',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=c2e39968-f46d-443d-a7af-f60dd087e905,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "address": "fa:16:3e:a7:f6:b4", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecd03ba6-ea", "ovs_interfaceid": "ecd03ba6-ea12-46a5-8e16-4328b52bc0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG os_vif [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecd03ba6-ea, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=423f8680-c5e4-4b88-a055-c7de4f9c3f88) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:43:14 user nova-compute[74075]: INFO os_vif [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=ecd03ba6-ea12-46a5-8e16-4328b52bc0fa,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecd03ba6-ea')
Oct 26 09:43:14 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Deleting instance files /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905_del
Oct 26 09:43:14 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Deletion of /opt/stack/data/nova/instances/c2e39968-f46d-443d-a7af-f60dd087e905_del complete
Oct 26 09:43:15 user nova-compute[74075]: INFO nova.compute.manager [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 09:43:15 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:43:15 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:43:15 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:43:16 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Took 1.30 seconds to deallocate network for instance.
Oct 26 09:43:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-5efe5349-a1f6-4267-90b6-e00c9948ecb8 req-80cd8797-e1c8-43a0-a81e-6da4eb622c83 service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-vif-deleted-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-2eeb0973-90d7-42d4-afb8-70fa1bf475a0 req-346c5205-8cdd-4ea1-8f28-440b2d18e4ce service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received event network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2eeb0973-90d7-42d4-afb8-70fa1bf475a0 req-346c5205-8cdd-4ea1-8f28-440b2d18e4ce service nova] Acquiring lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2eeb0973-90d7-42d4-afb8-70fa1bf475a0 req-346c5205-8cdd-4ea1-8f28-440b2d18e4ce service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2eeb0973-90d7-42d4-afb8-70fa1bf475a0 req-346c5205-8cdd-4ea1-8f28-440b2d18e4ce service nova] Lock "c2e39968-f46d-443d-a7af-f60dd087e905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-2eeb0973-90d7-42d4-afb8-70fa1bf475a0 req-346c5205-8cdd-4ea1-8f28-440b2d18e4ce service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] No waiting events found dispatching network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:43:16 user nova-compute[74075]: WARNING nova.compute.manager [req-2eeb0973-90d7-42d4-afb8-70fa1bf475a0 req-346c5205-8cdd-4ea1-8f28-440b2d18e4ce service nova] [instance: c2e39968-f46d-443d-a7af-f60dd087e905] Received unexpected event network-vif-plugged-ecd03ba6-ea12-46a5-8e16-4328b52bc0fa for instance with vm_state deleted and task_state None.
Oct 26 09:43:16 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:16 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Deleted allocations for instance c2e39968-f46d-443d-a7af-f60dd087e905
Oct 26 09:43:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-53ca8c92-0e26-40e5-af4f-63b18b0e50eb tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "c2e39968-f46d-443d-a7af-f60dd087e905" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-changed-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Refreshing instance network info cache due to event network-changed-9e121e6c-a896-4eea-81ea-c2a22a7fbec1. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:43:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] Acquiring lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:43:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] Acquired lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:43:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Refreshing network info cache for port 9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:43:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updated VIF entry in instance network info cache for port 9e121e6c-a896-4eea-81ea-c2a22a7fbec1. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:43:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updating instance_info_cache with network_info: [{"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:43:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6582b057-95a2-44b8-91d1-b05d25a9b1ca req-715be80b-0df6-4cce-901f-cfc2ef94d181 service nova] Releasing lock "refresh_cache-d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:43:36 user nova-compute[74075]: INFO nova.compute.manager [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Rebuilding instance
Oct 26 09:43:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-a306b364-dde0-4ada-8868-5f92b5474229 req-f96554e1-a0bf-4665-b65e-692cf20755ec service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-unplugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a306b364-dde0-4ada-8868-5f92b5474229 req-f96554e1-a0bf-4665-b65e-692cf20755ec service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a306b364-dde0-4ada-8868-5f92b5474229 req-f96554e1-a0bf-4665-b65e-692cf20755ec service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a306b364-dde0-4ada-8868-5f92b5474229 req-f96554e1-a0bf-4665-b65e-692cf20755ec service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-a306b364-dde0-4ada-8868-5f92b5474229 req-f96554e1-a0bf-4665-b65e-692cf20755ec service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-unplugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:43:36 user nova-compute[74075]: WARNING nova.compute.manager [req-a306b364-dde0-4ada-8868-5f92b5474229 req-f96554e1-a0bf-4665-b65e-692cf20755ec service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-unplugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state active and task_state rebuilding.
Oct 26 09:43:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance destroyed successfully.
Oct 26 09:43:37 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance destroyed successfully.
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1877626846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300777303',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcZZIk2zkIUHPsS9BD3ltrXs4U9SqHpluFWoqb38Y95MCbCzTgDQkxmAk8sPH3FUSm5DJiVkedmeVlU3VVlSSY/szljLnpPnKTnzG0bacZSENTaw60o5HK5qMlAK72tGg==',key_name='tempest-keypair-1526605894',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f136d23306b64c14a4d7433fbcc1ce47',ramdisk_id='',reservation_id='r-dirbl4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1238912120',owner_user_name='tempest-ServerActionsV293TestJSON-1238912120-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe323ea95a554c1cbb5d689cbe32a993',uuid=d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converting VIF {"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e121e6c-a8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f231037-3d6a-4133-89f1-8744f1cd7554) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:43:37 user nova-compute[74075]: INFO os_vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8')
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:43:37 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[44875465-c726-4472-9cb9-f3392ff8b4b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:43:37 user nova-compute[74075]: No targets found.
Oct 26 09:43:37 user nova-compute[74075]: iSNS:
Oct 26 09:43:37 user nova-compute[74075]: No targets found.
Oct 26 09:43:37 user nova-compute[74075]: STATIC:
Oct 26 09:43:37 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:43:37 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:43:37 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:43:37 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99
Oct 26 09:43:37 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:43:37 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:43:37 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:43:37 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:43:37 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:43:37 user nova-compute[74075]: FIRMWARE:
Oct 26 09:43:37 user nova-compute[74075]: No targets found.
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:43:37 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:43:37 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a60f2-db09-4839-924b-dbdb4db0ae39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e33e14-5c81-420d-87d4-50339873e590]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:37 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:43:37 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:37 user nova-compute[74075]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:43:37 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c139240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3846f4-2ec9-45c4-ace2-4f02d6f24044]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74d1f8-973b-4235-88c9-61cce54b23cf]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8603d724-ef27-4df3-b784-5bb6d96c790c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0641d01-071e-4d6d-a096-9900b385a0e5]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_55ffd439', '/dev/disk/by-id/scsi-1SCST_BIO55ffd439-f06d108e94c5c3f0', '/dev/disk/by-id/scsi-26630366431303865') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4689cf8-fca9-4c7d-8117-197f082da54f]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[44741012-d926-4429-ae9a-8d59fdba09d7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddbeecf-d1c5-4801-98eb-afd4ff2c7bd3]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]
Oct 26 09:43:37 user nova-compute[74075]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10fb63-2cde-4224-a187-9ebde7436b5d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== disconnect_volume: return (353ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:43:37 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Deleting instance files /opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e_del
Oct 26 09:43:37 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Deletion of /opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e_del complete
Oct 26 09:43:37 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e could not be found.
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:43:37 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e204ee-24ed-4bcd-a864-5f4ec6829c66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:43:37 user nova-compute[74075]: No targets found.
Oct 26 09:43:37 user nova-compute[74075]: iSNS:
Oct 26 09:43:37 user nova-compute[74075]: No targets found.
Oct 26 09:43:37 user nova-compute[74075]: STATIC:
Oct 26 09:43:37 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:43:37 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:43:37 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:43:37 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:43:37 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:43:37 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:43:37 user nova-compute[74075]: FIRMWARE:
Oct 26 09:43:37 user nova-compute[74075]: No targets found.
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:43:37 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:43:37 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa854293-a81e-4360-9abf-e6820b7a82ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7e2e21-2ae4-4395-b909-699c334c9343]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:37 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:43:37 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:43:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e96c0>, {}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Disconnecting from: [] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== disconnect_volume: return (84ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:43:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-3131a0ae-9e4e-4867-895d-87ffe63712e4 req-bf8f770d-ada7-4b0e-a0f7-744ffb1c621a service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3131a0ae-9e4e-4867-895d-87ffe63712e4 req-bf8f770d-ada7-4b0e-a0f7-744ffb1c621a service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3131a0ae-9e4e-4867-895d-87ffe63712e4 req-bf8f770d-ada7-4b0e-a0f7-744ffb1c621a service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3131a0ae-9e4e-4867-895d-87ffe63712e4 req-bf8f770d-ada7-4b0e-a0f7-744ffb1c621a service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-3131a0ae-9e4e-4867-895d-87ffe63712e4 req-bf8f770d-ada7-4b0e-a0f7-744ffb1c621a service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:43:38 user nova-compute[74075]: WARNING nova.compute.manager [req-3131a0ae-9e4e-4867-895d-87ffe63712e4 req-bf8f770d-ada7-4b0e-a0f7-744ffb1c621a service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state active and task_state rebuilding.
Oct 26 09:43:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Preparing to wait for external event volume-reimaged-fc4e9783-ce94-43d1-b719-fff64f2b4b99 {{(pid=74075) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:43:44 user nova-compute[74075]: INFO nova.compute.claims [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Claim successful on node user
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:43:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:43:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:43:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG nova.policy [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '729f5d24fc714c65b3c1a811e5cdf271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a627b8e169d4a97b075f16e150d972f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:43:45 user nova-compute[74075]: INFO nova.virt.block_device [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Booting with volume 111e0af2-260c-4de2-850a-51224f1d70dc at /dev/vda
Oct 26 09:43:45 user nova-compute[74075]: DEBUG os_brick.utils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5060901-1c3f-413d-80a4-f2ee178d4035]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5488a34-71d3-426b-b526-5b0fff8695a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f36fda-f3e5-4577-a6b8-13ac9422b9a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab372663-349c-4d3c-b32c-5277852a1b94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:43:45 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:43:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029befe-242c-408a-91e5-e00f43f323ea]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG os_brick.utils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating existing volume attachment record: 41678f35-ee52-42da-9ed4-752c5e40fb60 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Successfully created port: 21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Successfully updated port: 21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquired lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-changed-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Refreshing instance network info cache due to event network-changed-21e585b9-3802-49e4-82f1-0140ea968bc6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] Acquiring lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:43:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Releasing lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance network_info: |[{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] Acquired lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG nova.network.neutron [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Refreshing network info cache for port 21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG nova.network.neutron [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updated VIF entry in instance network info cache for port 21e585b9-3802-49e4-82f1-0140ea968bc6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG nova.network.neutron [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:43:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34e760bd-d922-4da8-9184-60f06e1d498a req-f413347e-8f14-45cf-ad47-8f59e735b7ea service nova] Releasing lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:43:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:57 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:43:57 user nova-compute[74075]: INFO nova.compute.claims [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Claim successful on node user
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.network.neutron [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:43:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:43:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Creating image(s)
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "/opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "/opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "/opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.064s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG nova.policy [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf9ff8178c904ceea3b85d797650a304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cb49aac77047538029297c23344641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.238s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk 1073741824" returned: 0 in 0.226s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.471s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.220s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG nova.network.neutron [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Successfully created port: 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Cannot resize image /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Ensure instance console log exists: /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:43:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Successfully updated port: 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquired lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-changed-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Refreshing instance network info cache due to event network-changed-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] Acquiring lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Releasing lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Instance network_info: |[{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] Acquired lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Refreshing network info cache for port 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Start _get_guest_xml network_info=[{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:44:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-565466708',display_name='tempest-TestStampPattern-server-565466708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-565466708',id=34,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUoA12fFzyxIidWvPzA82JwSs6uEZAWp7RKvuuCfDblrhjd6DrukV5OsNKW8Bc7RGvFWptS9TUXTjs7p+Xhq0qIjtUzg1YR7CMjVI5cXK132AArebr/4HHM8dfFtXG1w==',key_name='tempest-TestStampPattern-418773924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53cb49aac77047538029297c23344641',ramdisk_id='',reservation_id='r-4chmx9gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1997579810',owner_user_name='tempest-TestStampPattern-1997579810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:43:58Z,user_data=None,user_id='cf9ff8178c904ceea3b85d797650a304',uuid=b73b245a-454a-4082-87e1-2f759341a7a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converting VIF {"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'pci_devices' on Instance uuid b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:44:01 user nova-compute[74075]:   <uuid>b73b245a-454a-4082-87e1-2f759341a7a7</uuid>
Oct 26 09:44:01 user nova-compute[74075]:   <name>instance-00000022</name>
Oct 26 09:44:01 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:44:01 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:44:01 user nova-compute[74075]:   <metadata>
Oct 26 09:44:01 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:44:01 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:44:01 user nova-compute[74075]:       <nova:name>tempest-TestStampPattern-server-565466708</nova:name>
Oct 26 09:44:01 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:44:01</nova:creationTime>
Oct 26 09:44:01 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:44:01 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:44:01 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:44:01 user nova-compute[74075]:       <nova:owner>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:user uuid="cf9ff8178c904ceea3b85d797650a304">tempest-TestStampPattern-1997579810-project-member</nova:user>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:project uuid="53cb49aac77047538029297c23344641">tempest-TestStampPattern-1997579810</nova:project>
Oct 26 09:44:01 user nova-compute[74075]:       </nova:owner>
Oct 26 09:44:01 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:44:01 user nova-compute[74075]:       <nova:ports>
Oct 26 09:44:01 user nova-compute[74075]:         <nova:port uuid="23b6c2ad-e4c0-4329-bd6a-cbdb3b255568">
Oct 26 09:44:01 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:44:01 user nova-compute[74075]:         </nova:port>
Oct 26 09:44:01 user nova-compute[74075]:       </nova:ports>
Oct 26 09:44:01 user nova-compute[74075]:     </nova:instance>
Oct 26 09:44:01 user nova-compute[74075]:   </metadata>
Oct 26 09:44:01 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:44:01 user nova-compute[74075]:     <system>
Oct 26 09:44:01 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:44:01 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:44:01 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:44:01 user nova-compute[74075]:       <entry name="serial">b73b245a-454a-4082-87e1-2f759341a7a7</entry>
Oct 26 09:44:01 user nova-compute[74075]:       <entry name="uuid">b73b245a-454a-4082-87e1-2f759341a7a7</entry>
Oct 26 09:44:01 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:44:01 user nova-compute[74075]:     </system>
Oct 26 09:44:01 user nova-compute[74075]:   </sysinfo>
Oct 26 09:44:01 user nova-compute[74075]:   <os>
Oct 26 09:44:01 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:44:01 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:44:01 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:44:01 user nova-compute[74075]:   </os>
Oct 26 09:44:01 user nova-compute[74075]:   <features>
Oct 26 09:44:01 user nova-compute[74075]:     <acpi/>
Oct 26 09:44:01 user nova-compute[74075]:     <apic/>
Oct 26 09:44:01 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:44:01 user nova-compute[74075]:   </features>
Oct 26 09:44:01 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:44:01 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:44:01 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:44:01 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:44:01 user nova-compute[74075]:   </clock>
Oct 26 09:44:01 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:44:01 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:44:01 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:44:01 user nova-compute[74075]:   </cpu>
Oct 26 09:44:01 user nova-compute[74075]:   <devices>
Oct 26 09:44:01 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:44:01 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:44:01 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk"/>
Oct 26 09:44:01 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:44:01 user nova-compute[74075]:     </disk>
Oct 26 09:44:01 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:44:01 user nova-compute[74075]:       <mac address="fa:16:3e:5f:fa:31"/>
Oct 26 09:44:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:01 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:44:01 user nova-compute[74075]:       <target dev="tap23b6c2ad-e4"/>
Oct 26 09:44:01 user nova-compute[74075]:     </interface>
Oct 26 09:44:01 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:44:01 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/console.log" append="off"/>
Oct 26 09:44:01 user nova-compute[74075]:     </serial>
Oct 26 09:44:01 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:44:01 user nova-compute[74075]:     <video>
Oct 26 09:44:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:01 user nova-compute[74075]:     </video>
Oct 26 09:44:01 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:44:01 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:44:01 user nova-compute[74075]:     </rng>
Oct 26 09:44:01 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:44:01 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:44:01 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:44:01 user nova-compute[74075]:     </memballoon>
Oct 26 09:44:01 user nova-compute[74075]:   </devices>
Oct 26 09:44:01 user nova-compute[74075]: </domain>
Oct 26 09:44:01 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-565466708',display_name='tempest-TestStampPattern-server-565466708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-565466708',id=34,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUoA12fFzyxIidWvPzA82JwSs6uEZAWp7RKvuuCfDblrhjd6DrukV5OsNKW8Bc7RGvFWptS9TUXTjs7p+Xhq0qIjtUzg1YR7CMjVI5cXK132AArebr/4HHM8dfFtXG1w==',key_name='tempest-TestStampPattern-418773924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53cb49aac77047538029297c23344641',ramdisk_id='',reservation_id='r-4chmx9gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1997579810',owner_user_name='tempest-TestStampPattern-1997579810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:43:58Z,user_data=None,user_id='cf9ff8178c904ceea3b85d797650a304',uuid=b73b245a-454a-4082-87e1-2f759341a7a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converting VIF {"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG os_vif [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc314437-dde6-5923-a693-275ac7716165', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23b6c2ad-e4, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23b6c2ad-e4, col_values=(('qos', UUID('bc51c2b7-b5e2-48d2-80e0-329750854698')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23b6c2ad-e4, col_values=(('external_ids', {'iface-id': '23b6c2ad-e4c0-4329-bd6a-cbdb3b255568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:fa:31', 'vm-uuid': 'b73b245a-454a-4082-87e1-2f759341a7a7'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:01 user nova-compute[74075]: INFO os_vif [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4')
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No VIF found with MAC fa:16:3e:5f:fa:31, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updated VIF entry in instance network info cache for port 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7e3b7ec0-c1fc-4ab1-b28f-59126794c819 req-e80dddf7-8c83-47a2-9b3d-4d768f0dcc2d service nova] Releasing lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3431bf21-57bc-4fa0-b667-bdc16adacd10 req-1abd25ed-c496-4eff-ae65-7d7bdd175e8e service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3431bf21-57bc-4fa0-b667-bdc16adacd10 req-1abd25ed-c496-4eff-ae65-7d7bdd175e8e service nova] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3431bf21-57bc-4fa0-b667-bdc16adacd10 req-1abd25ed-c496-4eff-ae65-7d7bdd175e8e service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3431bf21-57bc-4fa0-b667-bdc16adacd10 req-1abd25ed-c496-4eff-ae65-7d7bdd175e8e service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-3431bf21-57bc-4fa0-b667-bdc16adacd10 req-1abd25ed-c496-4eff-ae65-7d7bdd175e8e service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] No waiting events found dispatching network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:03 user nova-compute[74075]: WARNING nova.compute.manager [req-3431bf21-57bc-4fa0-b667-bdc16adacd10 req-1abd25ed-c496-4eff-ae65-7d7bdd175e8e service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received unexpected event network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 for instance with vm_state building and task_state spawning.
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-fcf6e0e6-2a30-424f-a043-9907d61d4e56 req-3b89639d-1944-4237-8914-9f9f5597c105 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fcf6e0e6-2a30-424f-a043-9907d61d4e56 req-3b89639d-1944-4237-8914-9f9f5597c105 service nova] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fcf6e0e6-2a30-424f-a043-9907d61d4e56 req-3b89639d-1944-4237-8914-9f9f5597c105 service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fcf6e0e6-2a30-424f-a043-9907d61d4e56 req-3b89639d-1944-4237-8914-9f9f5597c105 service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-fcf6e0e6-2a30-424f-a043-9907d61d4e56 req-3b89639d-1944-4237-8914-9f9f5597c105 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] No waiting events found dispatching network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:06 user nova-compute[74075]: WARNING nova.compute.manager [req-fcf6e0e6-2a30-424f-a043-9907d61d4e56 req-3b89639d-1944-4237-8914-9f9f5597c105 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received unexpected event network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 for instance with vm_state building and task_state spawning.
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:44:08 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:08 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8015MB free_disk=24.969287872314453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Instance spawned successfully.
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:09 user nova-compute[74075]: INFO nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Took 10.69 seconds to spawn the instance on the hypervisor.
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9266332d-6d4a-4810-ab56-ce5019f74f04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b1e64231-fb6b-40d8-8edf-f91e6993f2da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:44:09 user nova-compute[74075]: INFO nova.compute.manager [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Took 11.63 seconds to build instance.
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-60b1faf4-8fb1-47ee-9db4-847948c5f7bd tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.763s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:44:09 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Creating image(s)
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Ensure instance console log exists: /opt/stack/data/nova/instances/ff518f36-defb-4f41-aaf0-9a1e5238a20d/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Start _get_guest_xml network_info=[{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '41678f35-ee52-42da-9ed4-752c5e40fb60', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff518f36-defb-4f41-aaf0-9a1e5238a20d', 'attached_at': '', 'detached_at': '', 'volume_id': '111e0af2-260c-4de2-850a-51224f1d70dc', 'serial': '111e0af2-260c-4de2-850a-51224f1d70dc'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:44:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:44:09 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:44:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:44:09 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:44:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:44:09 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f8984-862a-434a-a130-30a880c134f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:44:09 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.069s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8d122d-5ab1-4ab1-922a-aa98016a3537]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc] added
Oct 26 09:44:10 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[43760000-74f4-4b9c-ba0d-1eb1be0c0bef]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad62e908-ced4-4c2e-bc40-e390faf8a937]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlYitxXZ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlYitxXZ" returned: 0 in 0.039s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d5c801-964a-4283-a54b-97dc32041f30]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlYitxXZ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e26251-1f3f-4e20-8301-74259f3a1c6c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d55e1e-eda0-4d1f-b2ed-2036a55f38d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e836c6c-5e77-42ba-b0b6-73cfd9148080 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e836c6c-5e77-42ba-b0b6-73cfd9148080 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e836c6c-5e77-42ba-b0b6-73cfd9148080 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887abb9-ef73-4033-b395-bdb26a63368c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]
Oct 26 09:44:10 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.
Oct 26 09:44:10 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a7c70-3910-491d-86c4-87515a295048]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0870480-0d23-408d-9851-364ec417a2c9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e836c6c-5e77-42ba-b0b6-73cfd9148080 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e836c6c-5e77-42ba-b0b6-73cfd9148080 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:44:10 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e836c6c-5e77-42ba-b0b6-73cfd9148080 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:44:10 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:44:10 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.496s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[50132c89-01d7-496f-ab0f-1cdc88cd9a50]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:44:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Skipping network cache update for instance because it is Building. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.588s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== connect_volume: return (1591ms) {'type': 'block', 'scsi_wwn': '23765646132333737', 'path': '/dev/sdf'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765646132333737', 'path': '/dev/sdf'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-453913386',display_name='tempest-ServerActionsTestOtherA-server-453913386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-453913386',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-5gsnb35x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:43:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=ff518f36-defb-4f41-aaf0-9a1e5238a20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.objects.instance [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'pci_devices' on Instance uuid ff518f36-defb-4f41-aaf0-9a1e5238a20d {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:44:11 user nova-compute[74075]:   <uuid>ff518f36-defb-4f41-aaf0-9a1e5238a20d</uuid>
Oct 26 09:44:11 user nova-compute[74075]:   <name>instance-00000021</name>
Oct 26 09:44:11 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:44:11 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:44:11 user nova-compute[74075]:   <metadata>
Oct 26 09:44:11 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:44:11 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:44:11 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherA-server-453913386</nova:name>
Oct 26 09:44:11 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:44:09</nova:creationTime>
Oct 26 09:44:11 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:44:11 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:44:11 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:44:11 user nova-compute[74075]:       <nova:owner>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:user uuid="729f5d24fc714c65b3c1a811e5cdf271">tempest-ServerActionsTestOtherA-546437878-project-member</nova:user>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:project uuid="7a627b8e169d4a97b075f16e150d972f">tempest-ServerActionsTestOtherA-546437878</nova:project>
Oct 26 09:44:11 user nova-compute[74075]:       </nova:owner>
Oct 26 09:44:11 user nova-compute[74075]:       <nova:ports>
Oct 26 09:44:11 user nova-compute[74075]:         <nova:port uuid="21e585b9-3802-49e4-82f1-0140ea968bc6">
Oct 26 09:44:11 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:44:11 user nova-compute[74075]:         </nova:port>
Oct 26 09:44:11 user nova-compute[74075]:       </nova:ports>
Oct 26 09:44:11 user nova-compute[74075]:     </nova:instance>
Oct 26 09:44:11 user nova-compute[74075]:   </metadata>
Oct 26 09:44:11 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:44:11 user nova-compute[74075]:     <system>
Oct 26 09:44:11 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:44:11 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:44:11 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:44:11 user nova-compute[74075]:       <entry name="serial">ff518f36-defb-4f41-aaf0-9a1e5238a20d</entry>
Oct 26 09:44:11 user nova-compute[74075]:       <entry name="uuid">ff518f36-defb-4f41-aaf0-9a1e5238a20d</entry>
Oct 26 09:44:11 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:44:11 user nova-compute[74075]:     </system>
Oct 26 09:44:11 user nova-compute[74075]:   </sysinfo>
Oct 26 09:44:11 user nova-compute[74075]:   <os>
Oct 26 09:44:11 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:44:11 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:44:11 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:44:11 user nova-compute[74075]:   </os>
Oct 26 09:44:11 user nova-compute[74075]:   <features>
Oct 26 09:44:11 user nova-compute[74075]:     <acpi/>
Oct 26 09:44:11 user nova-compute[74075]:     <apic/>
Oct 26 09:44:11 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:44:11 user nova-compute[74075]:   </features>
Oct 26 09:44:11 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:44:11 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:44:11 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:44:11 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:44:11 user nova-compute[74075]:   </clock>
Oct 26 09:44:11 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:44:11 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:44:11 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:44:11 user nova-compute[74075]:   </cpu>
Oct 26 09:44:11 user nova-compute[74075]:   <devices>
Oct 26 09:44:11 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:44:11 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:44:11 user nova-compute[74075]:       <source dev="/dev/sdf"/>
Oct 26 09:44:11 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:44:11 user nova-compute[74075]:       <serial>111e0af2-260c-4de2-850a-51224f1d70dc</serial>
Oct 26 09:44:11 user nova-compute[74075]:     </disk>
Oct 26 09:44:11 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:44:11 user nova-compute[74075]:       <mac address="fa:16:3e:2f:52:55"/>
Oct 26 09:44:11 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:11 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:44:11 user nova-compute[74075]:       <target dev="tap21e585b9-38"/>
Oct 26 09:44:11 user nova-compute[74075]:     </interface>
Oct 26 09:44:11 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:44:11 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/ff518f36-defb-4f41-aaf0-9a1e5238a20d/console.log" append="off"/>
Oct 26 09:44:11 user nova-compute[74075]:     </serial>
Oct 26 09:44:11 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:44:11 user nova-compute[74075]:     <video>
Oct 26 09:44:11 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:11 user nova-compute[74075]:     </video>
Oct 26 09:44:11 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:44:11 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:44:11 user nova-compute[74075]:     </rng>
Oct 26 09:44:11 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:44:11 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:44:11 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:44:11 user nova-compute[74075]:     </memballoon>
Oct 26 09:44:11 user nova-compute[74075]:   </devices>
Oct 26 09:44:11 user nova-compute[74075]: </domain>
Oct 26 09:44:11 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-453913386',display_name='tempest-ServerActionsTestOtherA-server-453913386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-453913386',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-5gsnb35x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:43:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=ff518f36-defb-4f41-aaf0-9a1e5238a20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG os_vif [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1903d101-6fb4-58a7-8ead-e3b72a105db8', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21e585b9-38, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21e585b9-38, col_values=(('qos', UUID('4d7d89c5-8038-45aa-9da0-834514308b99')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21e585b9-38, col_values=(('external_ids', {'iface-id': '21e585b9-3802-49e4-82f1-0140ea968bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:52:55', 'vm-uuid': 'ff518f36-defb-4f41-aaf0-9a1e5238a20d'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:11 user nova-compute[74075]: INFO os_vif [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38')
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:44:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No VIF found with MAC fa:16:3e:2f:52:55, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:12 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:44:12 user nova-compute[74075]: INFO nova.compute.claims [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Claim successful on node user
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.network.neutron [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:44:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.policy [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7604ae732734f05aaa7aeebf8ef5e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07b30415774466817048f8090437ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:44:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Creating image(s)
Oct 26 09:44:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "/opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-8163aaca-4d5a-4a96-b8de-33b4f6f69e03 req-85b0c8ef-7c0e-4b56-9daf-7f706c3677b9 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8163aaca-4d5a-4a96-b8de-33b4f6f69e03 req-85b0c8ef-7c0e-4b56-9daf-7f706c3677b9 service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8163aaca-4d5a-4a96-b8de-33b4f6f69e03 req-85b0c8ef-7c0e-4b56-9daf-7f706c3677b9 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8163aaca-4d5a-4a96-b8de-33b4f6f69e03 req-85b0c8ef-7c0e-4b56-9daf-7f706c3677b9 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-8163aaca-4d5a-4a96-b8de-33b4f6f69e03 req-85b0c8ef-7c0e-4b56-9daf-7f706c3677b9 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:14 user nova-compute[74075]: WARNING nova.compute.manager [req-8163aaca-4d5a-4a96-b8de-33b4f6f69e03 req-85b0c8ef-7c0e-4b56-9daf-7f706c3677b9 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state building and task_state spawning.
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.549s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 req-a9d1ed8d-b44c-435c-a9af-0e934d7839e0 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event volume-reimaged-fc4e9783-ce94-43d1-b719-fff64f2b4b99 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 req-a9d1ed8d-b44c-435c-a9af-0e934d7839e0 service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 req-a9d1ed8d-b44c-435c-a9af-0e934d7839e0 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 req-a9d1ed8d-b44c-435c-a9af-0e934d7839e0 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 req-a9d1ed8d-b44c-435c-a9af-0e934d7839e0 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Processing event volume-reimaged-fc4e9783-ce94-43d1-b719-fff64f2b4b99 {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance event wait completed in 35 seconds for volume-reimaged {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:44:14 user nova-compute[74075]: INFO nova.virt.block_device [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Booting with volume fc4e9783-ce94-43d1-b719-fff64f2b4b99 at /dev/vda
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.251s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk 1073741824" returned: 0 in 0.060s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG os_brick.utils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[669bf9ae-7fa0-4c6c-8aec-12bcc1d9f437]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.084s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b7e168-2d80-473a-b714-09a88d61593a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.254s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff5d91c-d2ea-4bc8-985f-16d09d3b7a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e532aa5b-dd55-47ee-83fa-d26b4d2063ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:44:14 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:44:14 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a83b2-c672-46e6-866d-b43e8d67d791]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG os_brick.utils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== get_connector_properties: return (301ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updating existing volume attachment record: dde48ba4-816b-4b2c-8d09-1e9bb58a8331 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:44:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Successfully created port: 8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Cannot resize image /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Ensure instance console log exists: /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:15 user nova-compute[74075]: INFO nova.compute.manager [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Rescuing
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updating instance_info_cache with network_info: [{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Successfully updated port: 8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquired lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-changed-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Refreshing instance network info cache due to event network-changed-8c3aaaba-6b7d-4ae2-abff-8fae61e21732. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] Acquiring lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-a43a95ab-93a9-4d56-b345-cea89fce830d req-ff74da37-ac15-4412-97f5-38c75e47b3d7 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a43a95ab-93a9-4d56-b345-cea89fce830d req-ff74da37-ac15-4412-97f5-38c75e47b3d7 service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a43a95ab-93a9-4d56-b345-cea89fce830d req-ff74da37-ac15-4412-97f5-38c75e47b3d7 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a43a95ab-93a9-4d56-b345-cea89fce830d req-ff74da37-ac15-4412-97f5-38c75e47b3d7 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-a43a95ab-93a9-4d56-b345-cea89fce830d req-ff74da37-ac15-4412-97f5-38c75e47b3d7 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:16 user nova-compute[74075]: WARNING nova.compute.manager [req-a43a95ab-93a9-4d56-b345-cea89fce830d req-ff74da37-ac15-4412-97f5-38c75e47b3d7 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state building and task_state spawning.
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-0769a3ad-3a92-430c-87ce-c12cf1aae217 req-36ca2d08-ae93-47b4-9f2a-e1238cfc775b service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0769a3ad-3a92-430c-87ce-c12cf1aae217 req-36ca2d08-ae93-47b4-9f2a-e1238cfc775b service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0769a3ad-3a92-430c-87ce-c12cf1aae217 req-36ca2d08-ae93-47b4-9f2a-e1238cfc775b service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0769a3ad-3a92-430c-87ce-c12cf1aae217 req-36ca2d08-ae93-47b4-9f2a-e1238cfc775b service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-0769a3ad-3a92-430c-87ce-c12cf1aae217 req-36ca2d08-ae93-47b4-9f2a-e1238cfc775b service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:16 user nova-compute[74075]: WARNING nova.compute.manager [req-0769a3ad-3a92-430c-87ce-c12cf1aae217 req-36ca2d08-ae93-47b4-9f2a-e1238cfc775b service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state active and task_state rescuing.
Oct 26 09:44:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updating instance_info_cache with network_info: [{"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Releasing lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Instance network_info: |[{"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] Acquired lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Refreshing network info cache for port 8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Start _get_guest_xml network_info=[{"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:44:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2083812466',display_name='tempest-AttachVolumeNegativeTest-server-2083812466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2083812466',id=35,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAsO2kgPyQ0QX2XclHS0rZD89xrtPe+3Bd6mSyphcXT+SpEN2VnbAloGXXx04Cs6+BtpXXGM0daBk9Gi+56Wl0Fa4hzpLFGwWDUQpb0lUo5HL+gdQKT+pefYcKooGrB4A==',key_name='tempest-keypair-644287845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-9av086v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=3b9a4670-501d-4798-b4f1-fef51995caf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:16 user nova-compute[74075]: DEBUG nova.objects.instance [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b9a4670-501d-4798-b4f1-fef51995caf2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:44:17 user nova-compute[74075]:   <uuid>3b9a4670-501d-4798-b4f1-fef51995caf2</uuid>
Oct 26 09:44:17 user nova-compute[74075]:   <name>instance-00000023</name>
Oct 26 09:44:17 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:44:17 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:44:17 user nova-compute[74075]:   <metadata>
Oct 26 09:44:17 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:44:17 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:44:17 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2083812466</nova:name>
Oct 26 09:44:17 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:44:16</nova:creationTime>
Oct 26 09:44:17 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:44:17 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:44:17 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:44:17 user nova-compute[74075]:       <nova:owner>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:user uuid="c7604ae732734f05aaa7aeebf8ef5e1a">tempest-AttachVolumeNegativeTest-294403091-project-member</nova:user>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:project uuid="2e07b30415774466817048f8090437ee">tempest-AttachVolumeNegativeTest-294403091</nova:project>
Oct 26 09:44:17 user nova-compute[74075]:       </nova:owner>
Oct 26 09:44:17 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:44:17 user nova-compute[74075]:       <nova:ports>
Oct 26 09:44:17 user nova-compute[74075]:         <nova:port uuid="8c3aaaba-6b7d-4ae2-abff-8fae61e21732">
Oct 26 09:44:17 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 09:44:17 user nova-compute[74075]:         </nova:port>
Oct 26 09:44:17 user nova-compute[74075]:       </nova:ports>
Oct 26 09:44:17 user nova-compute[74075]:     </nova:instance>
Oct 26 09:44:17 user nova-compute[74075]:   </metadata>
Oct 26 09:44:17 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:44:17 user nova-compute[74075]:     <system>
Oct 26 09:44:17 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:44:17 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:44:17 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:44:17 user nova-compute[74075]:       <entry name="serial">3b9a4670-501d-4798-b4f1-fef51995caf2</entry>
Oct 26 09:44:17 user nova-compute[74075]:       <entry name="uuid">3b9a4670-501d-4798-b4f1-fef51995caf2</entry>
Oct 26 09:44:17 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:44:17 user nova-compute[74075]:     </system>
Oct 26 09:44:17 user nova-compute[74075]:   </sysinfo>
Oct 26 09:44:17 user nova-compute[74075]:   <os>
Oct 26 09:44:17 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:44:17 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:44:17 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:44:17 user nova-compute[74075]:   </os>
Oct 26 09:44:17 user nova-compute[74075]:   <features>
Oct 26 09:44:17 user nova-compute[74075]:     <acpi/>
Oct 26 09:44:17 user nova-compute[74075]:     <apic/>
Oct 26 09:44:17 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:44:17 user nova-compute[74075]:   </features>
Oct 26 09:44:17 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:44:17 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:44:17 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:44:17 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:44:17 user nova-compute[74075]:   </clock>
Oct 26 09:44:17 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:44:17 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:44:17 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:44:17 user nova-compute[74075]:   </cpu>
Oct 26 09:44:17 user nova-compute[74075]:   <devices>
Oct 26 09:44:17 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:44:17 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:44:17 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk"/>
Oct 26 09:44:17 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:44:17 user nova-compute[74075]:     </disk>
Oct 26 09:44:17 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:44:17 user nova-compute[74075]:       <mac address="fa:16:3e:23:81:26"/>
Oct 26 09:44:17 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:17 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:44:17 user nova-compute[74075]:       <target dev="tap8c3aaaba-6b"/>
Oct 26 09:44:17 user nova-compute[74075]:     </interface>
Oct 26 09:44:17 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:44:17 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/console.log" append="off"/>
Oct 26 09:44:17 user nova-compute[74075]:     </serial>
Oct 26 09:44:17 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:44:17 user nova-compute[74075]:     <video>
Oct 26 09:44:17 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:17 user nova-compute[74075]:     </video>
Oct 26 09:44:17 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:44:17 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:44:17 user nova-compute[74075]:     </rng>
Oct 26 09:44:17 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:44:17 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:44:17 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:44:17 user nova-compute[74075]:     </memballoon>
Oct 26 09:44:17 user nova-compute[74075]:   </devices>
Oct 26 09:44:17 user nova-compute[74075]: </domain>
Oct 26 09:44:17 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2083812466',display_name='tempest-AttachVolumeNegativeTest-server-2083812466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2083812466',id=35,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAsO2kgPyQ0QX2XclHS0rZD89xrtPe+3Bd6mSyphcXT+SpEN2VnbAloGXXx04Cs6+BtpXXGM0daBk9Gi+56Wl0Fa4hzpLFGwWDUQpb0lUo5HL+gdQKT+pefYcKooGrB4A==',key_name='tempest-keypair-644287845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-9av086v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=3b9a4670-501d-4798-b4f1-fef51995caf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG os_vif [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ce20f1b-6658-5894-81be-9a3b98a98b83', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c3aaaba-6b, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c3aaaba-6b, col_values=(('qos', UUID('73386655-b79f-421f-b2ad-261272829371')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c3aaaba-6b, col_values=(('external_ids', {'iface-id': '8c3aaaba-6b7d-4ae2-abff-8fae61e21732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:81:26', 'vm-uuid': '3b9a4670-501d-4798-b4f1-fef51995caf2'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: INFO os_vif [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b')
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance spawned successfully.
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:44:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance destroyed successfully.
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:23:81:26, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:44:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Attempting a stable device rescue
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74075) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:44:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Creating image(s)
Oct 26 09:44:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "/opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "/opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "a73329f52dcabdb9aeeca28473c688bfe52d3a37" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "a73329f52dcabdb9aeeca28473c688bfe52d3a37" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.network.neutron [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updated VIF entry in instance network info cache for port 8c3aaaba-6b7d-4ae2-abff-8fae61e21732. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.network.neutron [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updating instance_info_cache with network_info: [{"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f28eaa15-78d1-4cc4-9f96-da8d63fa56b4 req-6eef2998-e440-449d-9cbc-32d91edc7762 service nova] Releasing lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:17 user nova-compute[74075]: INFO nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Took 8.08 seconds to spawn the instance on the hypervisor.
Oct 26 09:44:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:44:18 user nova-compute[74075]: INFO nova.compute.manager [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Took 33.83 seconds to build instance.
Oct 26 09:44:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-138d7fe7-dda2-459c-80d3-7172a56be509 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.954s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-522eb62b-334a-4bc1-be53-a48ee65b7c7c req-f6347fd2-a7fc-4954-88b2-95299a19abe5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-522eb62b-334a-4bc1-be53-a48ee65b7c7c req-f6347fd2-a7fc-4954-88b2-95299a19abe5 service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-522eb62b-334a-4bc1-be53-a48ee65b7c7c req-f6347fd2-a7fc-4954-88b2-95299a19abe5 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-522eb62b-334a-4bc1-be53-a48ee65b7c7c req-f6347fd2-a7fc-4954-88b2-95299a19abe5 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-522eb62b-334a-4bc1-be53-a48ee65b7c7c req-f6347fd2-a7fc-4954-88b2-95299a19abe5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:18 user nova-compute[74075]: WARNING nova.compute.manager [req-522eb62b-334a-4bc1-be53-a48ee65b7c7c req-f6347fd2-a7fc-4954-88b2-95299a19abe5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state active and task_state rescuing.
Oct 26 09:44:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.part --force-share --output=json" returned: 0 in 0.332s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG nova.virt.images [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] 04a9d82c-60b8-480b-a4a1-eb3a7e752292 was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.part /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a83819e-157c-4da4-b061-c9b03f1c9c2b req-67365fb1-bf45-411a-9409-1bbdc66749d8 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a83819e-157c-4da4-b061-c9b03f1c9c2b req-67365fb1-bf45-411a-9409-1bbdc66749d8 service nova] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a83819e-157c-4da4-b061-c9b03f1c9c2b req-67365fb1-bf45-411a-9409-1bbdc66749d8 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1a83819e-157c-4da4-b061-c9b03f1c9c2b req-67365fb1-bf45-411a-9409-1bbdc66749d8 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-1a83819e-157c-4da4-b061-c9b03f1c9c2b req-67365fb1-bf45-411a-9409-1bbdc66749d8 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] No waiting events found dispatching network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:19 user nova-compute[74075]: WARNING nova.compute.manager [req-1a83819e-157c-4da4-b061-c9b03f1c9c2b req-67365fb1-bf45-411a-9409-1bbdc66749d8 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received unexpected event network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 for instance with vm_state building and task_state spawning.
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.part /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.converted" returned: 0 in 0.437s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37.converted --force-share --output=json" returned: 0 in 0.246s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "a73329f52dcabdb9aeeca28473c688bfe52d3a37" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.388s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "a73329f52dcabdb9aeeca28473c688bfe52d3a37" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "a73329f52dcabdb9aeeca28473c688bfe52d3a37" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37 --force-share --output=json" returned: 0 in 0.245s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37,backing_fmt=raw /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37,backing_fmt=raw /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue" returned: 0 in 0.059s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "a73329f52dcabdb9aeeca28473c688bfe52d3a37" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'migration_context' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<9266332d-6d4a-4810-ab56-ce5019f74f04> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Start _get_guest_xml network_info=[{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "vif_mac": "fa:16:3e:df:88:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04a9d82c-60b8-480b-a4a1-eb3a7e752292', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'a65022eb-1c4a-41d1-b28b-f401f0b7370c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9266332d-6d4a-4810-ab56-ce5019f74f04', 'attached_at': '', 'detached_at': '', 'volume_id': '55966697-c3de-4a15-9dea-4cc256ed075e', 'serial': '55966697-c3de-4a15-9dea-4cc256ed075e'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'resources' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<9266332d-6d4a-4810-ab56-ce5019f74f04> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'numa_topology' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<9266332d-6d4a-4810-ab56-ce5019f74f04> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:44:20 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:20 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<9266332d-6d4a-4810-ab56-ce5019f74f04> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:44:20 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:44:20 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:44:20 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec8973-45cf-4220-ba1e-ea6920f9b9b6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BaLeXRYp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 09:44:20 user nova-compute[74075]: node.name = iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:44:20 user nova-compute[74075]: node.tpgt = -1
Oct 26 09:44:20 user nova-compute[74075]: node.startup = automatic
Oct 26 09:44:20 user nova-compute[74075]: node.leading_login = No
Oct 26 09:44:20 user nova-compute[74075]: iface.iscsi_ifacename = default
Oct 26 09:44:20 user nova-compute[74075]: iface.net_ifacename = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.ipaddress = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.prefix_len = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.hwaddress = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.transport_name = tcp
Oct 26 09:44:20 user nova-compute[74075]: iface.initiatorname = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.vlan_id = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.vlan_priority = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.vlan_state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.iface_num = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.mtu = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.port = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.bootproto = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.subnet_mask = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.gateway = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_alt_client_id = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_dns = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_learn_iqn = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_vendor_id_state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_vendor_id = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.dhcp_slp_da = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.fragmentation = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.gratuitous_arp = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.incoming_forwarding = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.tos_state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.tos = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.ttl = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.delayed_ack = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.tcp_nagle = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.tcp_wsf_state = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.tcp_wsf = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.tcp_timer_scale = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.tcp_timestamp = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.redirect = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.def_task_mgmt_timeout = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.header_digest = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.data_digest = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.immediate_data = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.initial_r2t = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.data_seq_inorder = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.data_pdu_inorder = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.erl = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.max_receive_data_len = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.first_burst_len = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.max_outstanding_r2t = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.max_burst_len = 0
Oct 26 09:44:20 user nova-compute[74075]: iface.chap_auth = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.bidi_chap = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.strict_login_compliance = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.discovery_auth = <empty>
Oct 26 09:44:20 user nova-compute[74075]: iface.discovery_logout = <empty>
Oct 26 09:44:20 user nova-compute[74075]: node.discovery_address = <empty>
Oct 26 09:44:20 user nova-compute[74075]: node.discovery_port = 0
Oct 26 09:44:20 user nova-compute[74075]: node.discovery_type = static
Oct 26 09:44:20 user nova-compute[74075]: node.session.initial_cmdsn = 0
Oct 26 09:44:20 user nova-compute[74075]: node.session.initial_login_retry_max = 8
Oct 26 09:44:20 user nova-compute[74075]: node.session.xmit_thread_priority = -20
Oct 26 09:44:20 user nova-compute[74075]: node.session.cmds_max = 128
Oct 26 09:44:20 user nova-compute[74075]: node.session.queue_depth = 32
Oct 26 09:44:20 user nova-compute[74075]: node.session.nr_sessions = 1
Oct 26 09:44:20 user nova-compute[74075]: node.session.auth.authmethod = CHAP
Oct 26 09:44:20 user nova-compute[74075]: node.session.auth.username = BaLeXRYp
Oct 26 09:44:20 user nova-compute[74075]: node.session.auth.password = ***
Oct 26 09:44:20 user nova-compute[74075]: node.session.auth.username_in = <empty>
Oct 26 09:44:20 user nova-compute[74075]: node.session.auth.password_in = <empty>
Oct 26 09:44:20 user nova-compute[74075]: node.session.auth.chap_algs = MD5
Oct 26 09:44:20 user nova-compute[74075]: node.session.timeo.replacement_timeout = 120
Oct 26 09:44:20 user nova-compute[74075]: node.session.err_timeo.abort_timeout = 15
Oct 26 09:44:20 user nova-compute[74075]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 09:44:20 user nova-compute[74075]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 09:44:20 user nova-compute[74075]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.FastAbort = Yes
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.InitialR2T = No
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.ImmediateData = Yes
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.MaxConnections = 1
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 09:44:20 user nova-compute[74075]: node.session.iscsi.ERL = 0
Oct 26 09:44:20 user nova-compute[74075]: node.session.scan = manual
Oct 26 09:44:20 user nova-compute[74075]: node.session.reopen_max = 0
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].address = 172.16.0.220
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].port = 3260
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].startup = manual
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].tcp.window_size = 524288
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].tcp.type_of_service = 0
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].timeo.logout_timeout = 15
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].timeo.login_timeout = 15
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].timeo.auth_timeout = 45
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].iscsi.DataDigest = None
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].iscsi.IFMarker = No
Oct 26 09:44:20 user nova-compute[74075]: node.conn[0].iscsi.OFMarker = No
Oct 26 09:44:20 user nova-compute[74075]: # END RECORD
Oct 26 09:44:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6531ad54-c1d0-45d8-9cbb-0b864140b0e5]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[386cb4e3-c4f6-42d5-9d5c-b3a2357f264e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BaLeXRYp {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BaLeXRYp" returned: 0 in 0.048s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d7168-7c5f-4616-bd4c-fadb72d1e2f1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BaLeXRYp'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[538aba0d-ee9b-47c3-9ec6-d566f314a1a2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81a1d96-8cde-485e-9773-d543b42642a0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:44:20 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:44:20 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:44:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:44:20 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:44:20 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:44:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8289f3-adca-4b73-87f2-68f4cd5b6dc9]: (4, ('0 0 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.265s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== connect_volume: return (268ms) {'type': 'block', 'scsi_wwn': '23962623934333737', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962623934333737', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353160260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353160260',id=31,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-a5zdyaqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:43:07Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=9266332d-6d4a-4810-ab56-ce5019f74f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "vif_mac": "fa:16:3e:df:88:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "vif_mac": "fa:16:3e:df:88:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'pci_devices' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.objects.base [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Object Instance<9266332d-6d4a-4810-ab56-ce5019f74f04> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:44:20 user nova-compute[74075]:   <uuid>9266332d-6d4a-4810-ab56-ce5019f74f04</uuid>
Oct 26 09:44:20 user nova-compute[74075]:   <name>instance-0000001f</name>
Oct 26 09:44:20 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:44:20 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:44:20 user nova-compute[74075]:   <metadata>
Oct 26 09:44:20 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:44:20 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:44:20 user nova-compute[74075]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1353160260</nova:name>
Oct 26 09:44:20 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:44:20</nova:creationTime>
Oct 26 09:44:20 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:44:20 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:44:20 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:44:20 user nova-compute[74075]:       <nova:owner>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:user uuid="f05e6ea9a6e248e892fb237a31d4b1a1">tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member</nova:user>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:project uuid="abf8f091fdd04a9c8e5b14632402efae">tempest-ServerBootFromVolumeStableRescueTest-1733320520</nova:project>
Oct 26 09:44:20 user nova-compute[74075]:       </nova:owner>
Oct 26 09:44:20 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:44:20 user nova-compute[74075]:       <nova:ports>
Oct 26 09:44:20 user nova-compute[74075]:         <nova:port uuid="e5592cbe-13c0-48ad-8f2b-16ff8e70e46e">
Oct 26 09:44:20 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 09:44:20 user nova-compute[74075]:         </nova:port>
Oct 26 09:44:20 user nova-compute[74075]:       </nova:ports>
Oct 26 09:44:20 user nova-compute[74075]:     </nova:instance>
Oct 26 09:44:20 user nova-compute[74075]:   </metadata>
Oct 26 09:44:20 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:44:20 user nova-compute[74075]:     <system>
Oct 26 09:44:20 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:44:20 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:44:20 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:44:20 user nova-compute[74075]:       <entry name="serial">9266332d-6d4a-4810-ab56-ce5019f74f04</entry>
Oct 26 09:44:20 user nova-compute[74075]:       <entry name="uuid">9266332d-6d4a-4810-ab56-ce5019f74f04</entry>
Oct 26 09:44:20 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:44:20 user nova-compute[74075]:     </system>
Oct 26 09:44:20 user nova-compute[74075]:   </sysinfo>
Oct 26 09:44:20 user nova-compute[74075]:   <os>
Oct 26 09:44:20 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:44:20 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:44:20 user nova-compute[74075]:   </os>
Oct 26 09:44:20 user nova-compute[74075]:   <features>
Oct 26 09:44:20 user nova-compute[74075]:     <acpi/>
Oct 26 09:44:20 user nova-compute[74075]:     <apic/>
Oct 26 09:44:20 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:44:20 user nova-compute[74075]:   </features>
Oct 26 09:44:20 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:44:20 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:44:20 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:44:20 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:44:20 user nova-compute[74075]:   </clock>
Oct 26 09:44:20 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:44:20 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:44:20 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:44:20 user nova-compute[74075]:   </cpu>
Oct 26 09:44:20 user nova-compute[74075]:   <devices>
Oct 26 09:44:20 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:44:20 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:44:20 user nova-compute[74075]:       <source dev="/dev/sdd"/>
Oct 26 09:44:20 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:44:20 user nova-compute[74075]:       <serial>55966697-c3de-4a15-9dea-4cc256ed075e</serial>
Oct 26 09:44:20 user nova-compute[74075]:     </disk>
Oct 26 09:44:20 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:44:20 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:44:20 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue"/>
Oct 26 09:44:20 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 09:44:20 user nova-compute[74075]:       <boot order="1"/>
Oct 26 09:44:20 user nova-compute[74075]:     </disk>
Oct 26 09:44:20 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:44:20 user nova-compute[74075]:       <mac address="fa:16:3e:df:88:76"/>
Oct 26 09:44:20 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:20 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:44:20 user nova-compute[74075]:       <target dev="tape5592cbe-13"/>
Oct 26 09:44:20 user nova-compute[74075]:     </interface>
Oct 26 09:44:20 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:44:20 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/console.log" append="off"/>
Oct 26 09:44:20 user nova-compute[74075]:     </serial>
Oct 26 09:44:20 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:44:20 user nova-compute[74075]:     <video>
Oct 26 09:44:20 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:44:20 user nova-compute[74075]:     </video>
Oct 26 09:44:20 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:44:20 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:44:20 user nova-compute[74075]:     </rng>
Oct 26 09:44:20 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:44:20 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:44:20 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:44:20 user nova-compute[74075]:     </memballoon>
Oct 26 09:44:20 user nova-compute[74075]:   </devices>
Oct 26 09:44:20 user nova-compute[74075]: </domain>
Oct 26 09:44:20 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:44:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance destroyed successfully.
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:44:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] No VIF found with MAC fa:16:3e:df:88:76, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-ad53375f-7cf4-4827-ab56-d96ae1dd86f6 req-d9534b88-d94d-4251-9310-4c3cfa327bb6 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ad53375f-7cf4-4827-ab56-d96ae1dd86f6 req-d9534b88-d94d-4251-9310-4c3cfa327bb6 service nova] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ad53375f-7cf4-4827-ab56-d96ae1dd86f6 req-d9534b88-d94d-4251-9310-4c3cfa327bb6 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ad53375f-7cf4-4827-ab56-d96ae1dd86f6 req-d9534b88-d94d-4251-9310-4c3cfa327bb6 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-ad53375f-7cf4-4827-ab56-d96ae1dd86f6 req-d9534b88-d94d-4251-9310-4c3cfa327bb6 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] No waiting events found dispatching network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:21 user nova-compute[74075]: WARNING nova.compute.manager [req-ad53375f-7cf4-4827-ab56-d96ae1dd86f6 req-d9534b88-d94d-4251-9310-4c3cfa327bb6 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received unexpected event network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 for instance with vm_state building and task_state spawning.
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:44:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Instance spawned successfully.
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:44:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:22 user nova-compute[74075]: INFO nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Took 8.56 seconds to spawn the instance on the hypervisor.
Oct 26 09:44:22 user nova-compute[74075]: DEBUG nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:44:22 user nova-compute[74075]: INFO nova.compute.manager [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Took 9.77 seconds to build instance.
Oct 26 09:44:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-95bfd529-7277-4541-b4bb-c75aeace3b52 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.934s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-de867efe-5387-4746-b708-dd0593b5a024 req-21f5a400-e298-4595-99b5-b3d797fea7e6 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-de867efe-5387-4746-b708-dd0593b5a024 req-21f5a400-e298-4595-99b5-b3d797fea7e6 service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-de867efe-5387-4746-b708-dd0593b5a024 req-21f5a400-e298-4595-99b5-b3d797fea7e6 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-de867efe-5387-4746-b708-dd0593b5a024 req-21f5a400-e298-4595-99b5-b3d797fea7e6 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-de867efe-5387-4746-b708-dd0593b5a024 req-21f5a400-e298-4595-99b5-b3d797fea7e6 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:23 user nova-compute[74075]: WARNING nova.compute.manager [req-de867efe-5387-4746-b708-dd0593b5a024 req-21f5a400-e298-4595-99b5-b3d797fea7e6 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state active and task_state rescuing.
Oct 26 09:44:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-1040e20a-055b-406a-9329-ecc00cfc0ac8 req-21a54a71-5d47-4163-8320-322e787ecbbd service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1040e20a-055b-406a-9329-ecc00cfc0ac8 req-21a54a71-5d47-4163-8320-322e787ecbbd service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1040e20a-055b-406a-9329-ecc00cfc0ac8 req-21a54a71-5d47-4163-8320-322e787ecbbd service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1040e20a-055b-406a-9329-ecc00cfc0ac8 req-21a54a71-5d47-4163-8320-322e787ecbbd service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-1040e20a-055b-406a-9329-ecc00cfc0ac8 req-21a54a71-5d47-4163-8320-322e787ecbbd service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:44:25 user nova-compute[74075]: WARNING nova.compute.manager [req-1040e20a-055b-406a-9329-ecc00cfc0ac8 req-21a54a71-5d47-4163-8320-322e787ecbbd service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state active and task_state rescuing.
Oct 26 09:44:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e332019a-4a4f-4dad-b349-700f86d074a2 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:44:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-changed-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:44:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Refreshing instance network info cache due to event network-changed-3ac366dd-deee-4116-bc3c-a22a05450676. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:44:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] Acquiring lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:44:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] Acquired lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:44:31 user nova-compute[74075]: DEBUG nova.network.neutron [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Refreshing network info cache for port 3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:44:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:32 user nova-compute[74075]: DEBUG nova.network.neutron [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updated VIF entry in instance network info cache for port 3ac366dd-deee-4116-bc3c-a22a05450676. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:44:32 user nova-compute[74075]: DEBUG nova.network.neutron [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updating instance_info_cache with network_info: [{"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:44:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b829b71e-ad37-4bd8-8f32-ab9f56f3b0d7 req-5213d58c-3518-4136-bdde-1609438fa1e0 service nova] Releasing lock "refresh_cache-b1e64231-fb6b-40d8-8edf-f91e6993f2da" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:44:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lazy-loading 'flavor' on Instance uuid b1e64231-fb6b-40d8-8edf-f91e6993f2da {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:44:41 user nova-compute[74075]: INFO nova.compute.manager [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Attaching volume 3c26a8fc-6104-4de2-bcc2-105781868980 to /dev/vdb
Oct 26 09:44:41 user nova-compute[74075]: DEBUG os_brick.utils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecde58b-fddd-48e1-bc67-45023cbdea89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[92067b0b-9e77-44cb-ac56-bd0bdc60c9ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53cc39f-b976-4011-82e8-36b10d0f46f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933b30f-0570-4581-918c-9b78a1d94534]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:44:41 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:44:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a10d36-6f31-43bb-95d1-358aa6fc4941]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG os_brick.utils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:44:41 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updating existing volume attachment record: 88add51d-f5da-43c5-87bc-b0399a11f701 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:44:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:44:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:45:00 user nova-compute[74075]: INFO nova.compute.claims [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Claim successful on node user
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:45:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:45:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:45:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Creating image(s)
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "/opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "/opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG nova.policy [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ecad0daaf5f4013a82174a02c2a1213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd1bed154a45eeb68f065f7222870d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.211s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk 1073741824" returned: 0 in 0.065s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:45:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Cannot resize image /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Ensure instance console log exists: /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Successfully created port: 87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Successfully updated port: 87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquired lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-changed-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Refreshing instance network info cache due to event network-changed-87db5054-6998-4feb-92a9-ce407ec5728e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] Acquiring lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating instance_info_cache with network_info: [{"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Releasing lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Instance network_info: |[{"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] Acquired lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Refreshing network info cache for port 87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Start _get_guest_xml network_info=[{"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:45:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:45:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:44:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1440831571',display_name='tempest-SnapshotDataIntegrityTests-server-1440831571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1440831571',id=36,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgAbyD2HugliqyG53yNz4GMSBuWTvc3QbOBCugV2khENHBCXRD6+WILMPoypDpeT3TLOMKCUVB45KV/IgzP8GCvylpf/SfiiU3jQe6nsQ1wy7mNSdKc4ZLl/xDchHWbtQ==',key_name='tempest-keypair-769290502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bd1bed154a45eeb68f065f7222870d',ramdisk_id='',reservation_id='r-wyx1z3j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-599902097',owner_user_name='tempest-SnapshotDataIntegrityTests-599902097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ecad0daaf5f4013a82174a02c2a1213',uuid=4b80a751-1c08-48c8-a2f4-e6c9ff01d479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Converting VIF {"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:45:03 user nova-compute[74075]:   <uuid>4b80a751-1c08-48c8-a2f4-e6c9ff01d479</uuid>
Oct 26 09:45:03 user nova-compute[74075]:   <name>instance-00000024</name>
Oct 26 09:45:03 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:45:03 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:45:03 user nova-compute[74075]:   <metadata>
Oct 26 09:45:03 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:45:03 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:45:03 user nova-compute[74075]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1440831571</nova:name>
Oct 26 09:45:03 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:45:03</nova:creationTime>
Oct 26 09:45:03 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:45:03 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:45:03 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:45:03 user nova-compute[74075]:       <nova:owner>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:user uuid="4ecad0daaf5f4013a82174a02c2a1213">tempest-SnapshotDataIntegrityTests-599902097-project-member</nova:user>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:project uuid="81bd1bed154a45eeb68f065f7222870d">tempest-SnapshotDataIntegrityTests-599902097</nova:project>
Oct 26 09:45:03 user nova-compute[74075]:       </nova:owner>
Oct 26 09:45:03 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:45:03 user nova-compute[74075]:       <nova:ports>
Oct 26 09:45:03 user nova-compute[74075]:         <nova:port uuid="87db5054-6998-4feb-92a9-ce407ec5728e">
Oct 26 09:45:03 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 09:45:03 user nova-compute[74075]:         </nova:port>
Oct 26 09:45:03 user nova-compute[74075]:       </nova:ports>
Oct 26 09:45:03 user nova-compute[74075]:     </nova:instance>
Oct 26 09:45:03 user nova-compute[74075]:   </metadata>
Oct 26 09:45:03 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:45:03 user nova-compute[74075]:     <system>
Oct 26 09:45:03 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:45:03 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:45:03 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:45:03 user nova-compute[74075]:       <entry name="serial">4b80a751-1c08-48c8-a2f4-e6c9ff01d479</entry>
Oct 26 09:45:03 user nova-compute[74075]:       <entry name="uuid">4b80a751-1c08-48c8-a2f4-e6c9ff01d479</entry>
Oct 26 09:45:03 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:45:03 user nova-compute[74075]:     </system>
Oct 26 09:45:03 user nova-compute[74075]:   </sysinfo>
Oct 26 09:45:03 user nova-compute[74075]:   <os>
Oct 26 09:45:03 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:45:03 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:45:03 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:45:03 user nova-compute[74075]:   </os>
Oct 26 09:45:03 user nova-compute[74075]:   <features>
Oct 26 09:45:03 user nova-compute[74075]:     <acpi/>
Oct 26 09:45:03 user nova-compute[74075]:     <apic/>
Oct 26 09:45:03 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:45:03 user nova-compute[74075]:   </features>
Oct 26 09:45:03 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:45:03 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:45:03 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:45:03 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:45:03 user nova-compute[74075]:   </clock>
Oct 26 09:45:03 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:45:03 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:45:03 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:45:03 user nova-compute[74075]:   </cpu>
Oct 26 09:45:03 user nova-compute[74075]:   <devices>
Oct 26 09:45:03 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:45:03 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:45:03 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk"/>
Oct 26 09:45:03 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:45:03 user nova-compute[74075]:     </disk>
Oct 26 09:45:03 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:45:03 user nova-compute[74075]:       <mac address="fa:16:3e:7b:13:18"/>
Oct 26 09:45:03 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:45:03 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:45:03 user nova-compute[74075]:       <target dev="tap87db5054-69"/>
Oct 26 09:45:03 user nova-compute[74075]:     </interface>
Oct 26 09:45:03 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:45:03 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/console.log" append="off"/>
Oct 26 09:45:03 user nova-compute[74075]:     </serial>
Oct 26 09:45:03 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:45:03 user nova-compute[74075]:     <video>
Oct 26 09:45:03 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:45:03 user nova-compute[74075]:     </video>
Oct 26 09:45:03 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:45:03 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:45:03 user nova-compute[74075]:     </rng>
Oct 26 09:45:03 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:45:03 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:45:03 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:45:03 user nova-compute[74075]:     </memballoon>
Oct 26 09:45:03 user nova-compute[74075]:   </devices>
Oct 26 09:45:03 user nova-compute[74075]: </domain>
Oct 26 09:45:03 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:44:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1440831571',display_name='tempest-SnapshotDataIntegrityTests-server-1440831571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1440831571',id=36,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgAbyD2HugliqyG53yNz4GMSBuWTvc3QbOBCugV2khENHBCXRD6+WILMPoypDpeT3TLOMKCUVB45KV/IgzP8GCvylpf/SfiiU3jQe6nsQ1wy7mNSdKc4ZLl/xDchHWbtQ==',key_name='tempest-keypair-769290502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bd1bed154a45eeb68f065f7222870d',ramdisk_id='',reservation_id='r-wyx1z3j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-599902097',owner_user_name='tempest-SnapshotDataIntegrityTests-599902097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ecad0daaf5f4013a82174a02c2a1213',uuid=4b80a751-1c08-48c8-a2f4-e6c9ff01d479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Converting VIF {"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_vif [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d4ad7f2-baf9-5b90-90f6-9ce68a974062', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87db5054-69, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87db5054-69, col_values=(('qos', UUID('1db1d1ba-ee39-40c4-9ea5-1b8fc6f647e4')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87db5054-69, col_values=(('external_ids', {'iface-id': '87db5054-6998-4feb-92a9-ce407ec5728e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:13:18', 'vm-uuid': '4b80a751-1c08-48c8-a2f4-e6c9ff01d479'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:03 user nova-compute[74075]: INFO os_vif [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69')
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No VIF found with MAC fa:16:3e:7b:13:18, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzakGiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:45:03 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:45:03 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:45:03 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfbba14-0097-4df3-a23b-6786859ab236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:45:03 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[230401e2-b803-41dc-8178-37489840549f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980] added
Oct 26 09:45:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updated VIF entry in instance network info cache for port 87db5054-6998-4feb-92a9-ce407ec5728e. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating instance_info_cache with network_info: [{"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f37a1f-025b-4de2-8f99-558ea037143f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-798ec0d9-5645-44d6-a5f8-ff52c835702b req-08055a37-bde9-4215-a9ea-3524346fc577 service nova] Releasing lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[463afddc-89a2-44ec-a433-2e78d940fafe]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzakGiDr {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzakGiDr" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92b54d5-d3dc-4a13-8d75-cffac0839914]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YzakGiDr'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222f585-ec42-468c-adda-4e2315f97ad7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae99dd8-2d8d-4aea-88ae-4e4e85dd1862]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa042c3-511b-4b31-98e4-5da003f82e3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260]
Oct 26 09:45:03 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260] successful.
Oct 26 09:45:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6678d7-98af-4da5-b5b6-59e476d448b3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b8c69-de82-4773-a484-ad449184c6db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:03 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda8a26-f451-419d-bed6-063396b083c8]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzakGiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23463396138323261', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463396138323261', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lazy-loading 'flavor' on Instance uuid b1e64231-fb6b-40d8-8edf-f91e6993f2da {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:45:05 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:45:05 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:45:05 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:45:05 user nova-compute[74075]:   <serial>3c26a8fc-6104-4de2-bcc2-105781868980</serial>
Oct 26 09:45:05 user nova-compute[74075]: </disk>
Oct 26 09:45:05 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-4c4f86b2-5b0a-46d7-910a-c758617b2571 req-86132b30-8d90-4c14-9101-1bcbe2269ff6 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4c4f86b2-5b0a-46d7-910a-c758617b2571 req-86132b30-8d90-4c14-9101-1bcbe2269ff6 service nova] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4c4f86b2-5b0a-46d7-910a-c758617b2571 req-86132b30-8d90-4c14-9101-1bcbe2269ff6 service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4c4f86b2-5b0a-46d7-910a-c758617b2571 req-86132b30-8d90-4c14-9101-1bcbe2269ff6 service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-4c4f86b2-5b0a-46d7-910a-c758617b2571 req-86132b30-8d90-4c14-9101-1bcbe2269ff6 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] No waiting events found dispatching network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:45:05 user nova-compute[74075]: WARNING nova.compute.manager [req-4c4f86b2-5b0a-46d7-910a-c758617b2571 req-86132b30-8d90-4c14-9101-1bcbe2269ff6 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received unexpected event network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e for instance with vm_state building and task_state spawning.
Oct 26 09:45:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] No VIF found with MAC fa:16:3e:7f:3a:38, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:45:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Creating image(s)
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Ensure instance console log exists: /opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Start _get_guest_xml network_info=[{"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'dde48ba4-816b-4b2c-8d09-1e9bb58a8331', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'serial': 'fc4e9783-ce94-43d1-b719-fff64f2b4b99'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:45:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 09:45:05 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:45:05 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:45:05 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:45:05 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9679d45-af91-4fb4-975a-241c6f7946a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:45:05 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-52b0ff69-0618-42e4-9efd-ca3666fc2493 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.653s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8394039e-7806-4882-b70a-5834cdefce47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99] added
Oct 26 09:45:05 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[19516b25-1903-4b52-b00f-565045eec604]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[655b941a-c350-4ef0-9a5d-86e507a224b3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMySXkFe {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMySXkFe" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdb3d1d-1219-4b8f-935c-a79379ee8275]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMySXkFe'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.102s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a87b27-d339-4095-baa9-aa2adac7995f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[62700cb4-f6c8-4d25-a7ba-94cd948e0518]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3c8f4c-1066-4d14-ae9b-8688c3c6c71e (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3c8f4c-1066-4d14-ae9b-8688c3c6c71e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3c8f4c-1066-4d14-ae9b-8688c3c6c71e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[91109a1c-2cf1-465a-baf8-6507105c194d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]
Oct 26 09:45:06 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.
Oct 26 09:45:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ae449f-6c3b-41a7-8219-0e2d4c5e3e60]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd570a-64a0-43e0-ab4c-96c263ec4aad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3c8f4c-1066-4d14-ae9b-8688c3c6c71e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3c8f4c-1066-4d14-ae9b-8688c3c6c71e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3c8f4c-1066-4d14-ae9b-8688c3c6c71e (non-flash)
Oct 26 09:45:06 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:45:06 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.611s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bdd118-3842-444f-9f3d-0a7360df02c0]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:45:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-c64b7be5-0781-409e-9d9c-39cd96a8e9de req-f11220d6-5be2-4dfb-9559-98b4a0cfb2db service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c64b7be5-0781-409e-9d9c-39cd96a8e9de req-f11220d6-5be2-4dfb-9559-98b4a0cfb2db service nova] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c64b7be5-0781-409e-9d9c-39cd96a8e9de req-f11220d6-5be2-4dfb-9559-98b4a0cfb2db service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c64b7be5-0781-409e-9d9c-39cd96a8e9de req-f11220d6-5be2-4dfb-9559-98b4a0cfb2db service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-c64b7be5-0781-409e-9d9c-39cd96a8e9de req-f11220d6-5be2-4dfb-9559-98b4a0cfb2db service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] No waiting events found dispatching network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:45:07 user nova-compute[74075]: WARNING nova.compute.manager [req-c64b7be5-0781-409e-9d9c-39cd96a8e9de req-f11220d6-5be2-4dfb-9559-98b4a0cfb2db service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received unexpected event network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e for instance with vm_state building and task_state spawning.
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.660s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== connect_volume: return (1664ms) {'type': 'block', 'scsi_wwn': '26630366431303865', 'path': '/dev/sdg'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630366431303865', 'path': '/dev/sdg'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1877626846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300777303',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcZZIk2zkIUHPsS9BD3ltrXs4U9SqHpluFWoqb38Y95MCbCzTgDQkxmAk8sPH3FUSm5DJiVkedmeVlU3VVlSSY/szljLnpPnKTnzG0bacZSENTaw60o5HK5qMlAK72tGg==',key_name='tempest-keypair-1526605894',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f136d23306b64c14a4d7433fbcc1ce47',ramdisk_id='',reservation_id='r-dirbl4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1238912120',owner_user_name='tempest-ServerActionsV293TestJSON-1238912120-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe323ea95a554c1cbb5d689cbe32a993',uuid=d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converting VIF {"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:45:07 user nova-compute[74075]:   <uuid>d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e</uuid>
Oct 26 09:45:07 user nova-compute[74075]:   <name>instance-0000001e</name>
Oct 26 09:45:07 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:45:07 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:45:07 user nova-compute[74075]:   <metadata>
Oct 26 09:45:07 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:45:07 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:45:07 user nova-compute[74075]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1877626846</nova:name>
Oct 26 09:45:07 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:45:05</nova:creationTime>
Oct 26 09:45:07 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:45:07 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:45:07 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:45:07 user nova-compute[74075]:       <nova:owner>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:user uuid="fe323ea95a554c1cbb5d689cbe32a993">tempest-ServerActionsV293TestJSON-1238912120-project-member</nova:user>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:project uuid="f136d23306b64c14a4d7433fbcc1ce47">tempest-ServerActionsV293TestJSON-1238912120</nova:project>
Oct 26 09:45:07 user nova-compute[74075]:       </nova:owner>
Oct 26 09:45:07 user nova-compute[74075]:       <nova:ports>
Oct 26 09:45:07 user nova-compute[74075]:         <nova:port uuid="9e121e6c-a896-4eea-81ea-c2a22a7fbec1">
Oct 26 09:45:07 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 09:45:07 user nova-compute[74075]:         </nova:port>
Oct 26 09:45:07 user nova-compute[74075]:       </nova:ports>
Oct 26 09:45:07 user nova-compute[74075]:     </nova:instance>
Oct 26 09:45:07 user nova-compute[74075]:   </metadata>
Oct 26 09:45:07 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:45:07 user nova-compute[74075]:     <system>
Oct 26 09:45:07 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:45:07 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:45:07 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:45:07 user nova-compute[74075]:       <entry name="serial">d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e</entry>
Oct 26 09:45:07 user nova-compute[74075]:       <entry name="uuid">d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e</entry>
Oct 26 09:45:07 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:45:07 user nova-compute[74075]:     </system>
Oct 26 09:45:07 user nova-compute[74075]:   </sysinfo>
Oct 26 09:45:07 user nova-compute[74075]:   <os>
Oct 26 09:45:07 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:45:07 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:45:07 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:45:07 user nova-compute[74075]:   </os>
Oct 26 09:45:07 user nova-compute[74075]:   <features>
Oct 26 09:45:07 user nova-compute[74075]:     <acpi/>
Oct 26 09:45:07 user nova-compute[74075]:     <apic/>
Oct 26 09:45:07 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:45:07 user nova-compute[74075]:   </features>
Oct 26 09:45:07 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:45:07 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:45:07 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:45:07 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:45:07 user nova-compute[74075]:   </clock>
Oct 26 09:45:07 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:45:07 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:45:07 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:45:07 user nova-compute[74075]:   </cpu>
Oct 26 09:45:07 user nova-compute[74075]:   <devices>
Oct 26 09:45:07 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:45:07 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:45:07 user nova-compute[74075]:       <source dev="/dev/sdg"/>
Oct 26 09:45:07 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:45:07 user nova-compute[74075]:       <serial>fc4e9783-ce94-43d1-b719-fff64f2b4b99</serial>
Oct 26 09:45:07 user nova-compute[74075]:     </disk>
Oct 26 09:45:07 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:45:07 user nova-compute[74075]:       <mac address="fa:16:3e:6e:de:ad"/>
Oct 26 09:45:07 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:45:07 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:45:07 user nova-compute[74075]:       <target dev="tap9e121e6c-a8"/>
Oct 26 09:45:07 user nova-compute[74075]:     </interface>
Oct 26 09:45:07 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:45:07 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e/console.log" append="off"/>
Oct 26 09:45:07 user nova-compute[74075]:     </serial>
Oct 26 09:45:07 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:45:07 user nova-compute[74075]:     <video>
Oct 26 09:45:07 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:45:07 user nova-compute[74075]:     </video>
Oct 26 09:45:07 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:45:07 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:45:07 user nova-compute[74075]:     </rng>
Oct 26 09:45:07 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:45:07 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:45:07 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:45:07 user nova-compute[74075]:     </memballoon>
Oct 26 09:45:07 user nova-compute[74075]:   </devices>
Oct 26 09:45:07 user nova-compute[74075]: </domain>
Oct 26 09:45:07 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1877626846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300777303',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcZZIk2zkIUHPsS9BD3ltrXs4U9SqHpluFWoqb38Y95MCbCzTgDQkxmAk8sPH3FUSm5DJiVkedmeVlU3VVlSSY/szljLnpPnKTnzG0bacZSENTaw60o5HK5qMlAK72tGg==',key_name='tempest-keypair-1526605894',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f136d23306b64c14a4d7433fbcc1ce47',ramdisk_id='',reservation_id='r-dirbl4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1238912120',owner_user_name='tempest-ServerActionsV293TestJSON-1238912120-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe323ea95a554c1cbb5d689cbe32a993',uuid=d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converting VIF {"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG os_vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd4e196f-32d2-530c-9fa5-2842a04c9264', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e121e6c-a8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e121e6c-a8, col_values=(('qos', UUID('91cb3b82-797a-409f-a979-c7d29af012ee')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e121e6c-a8, col_values=(('external_ids', {'iface-id': '9e121e6c-a896-4eea-81ea-c2a22a7fbec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:de:ad', 'vm-uuid': 'd6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:07 user nova-compute[74075]: INFO os_vif [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8')
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] No VIF found with MAC fa:16:3e:6e:de:ad, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:45:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Instance spawned successfully.
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:07 user nova-compute[74075]: INFO nova.compute.manager [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Detaching volume 3c26a8fc-6104-4de2-bcc2-105781868980
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:08 user nova-compute[74075]: INFO nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Took 6.94 seconds to spawn the instance on the hypervisor.
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:45:08 user nova-compute[74075]: INFO nova.virt.block_device [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Attempting to driver detach volume 3c26a8fc-6104-4de2-bcc2-105781868980 from mountpoint /dev/vdb
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Attempting to detach device vdb from instance b1e64231-fb6b-40d8-8edf-f91e6993f2da from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:45:08 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:45:08 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:45:08 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:45:08 user nova-compute[74075]:   <serial>3c26a8fc-6104-4de2-bcc2-105781868980</serial>
Oct 26 09:45:08 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:45:08 user nova-compute[74075]: </disk>
Oct 26 09:45:08 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:45:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Successfully detached device vdb from instance b1e64231-fb6b-40d8-8edf-f91e6993f2da from the persistent domain config.
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1e64231-fb6b-40d8-8edf-f91e6993f2da from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:45:08 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:45:08 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:45:08 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:45:08 user nova-compute[74075]:   <serial>3c26a8fc-6104-4de2-bcc2-105781868980</serial>
Oct 26 09:45:08 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:45:08 user nova-compute[74075]: </disk>
Oct 26 09:45:08 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:45:08 user nova-compute[74075]: INFO nova.compute.manager [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Took 7.85 seconds to build instance.
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dc03bd40-b121-47b8-b34b-b9eb392479ed tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.016s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1e64231-fb6b-40d8-8edf-f91e6993f2da {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:45:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:10 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:45:10 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7534MB free_disk=25.165489196777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-7164443b-2e24-4a93-b3ef-50a33f67d5d0 req-75719d49-5283-4037-8c16-5922bfd4a787 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7164443b-2e24-4a93-b3ef-50a33f67d5d0 req-75719d49-5283-4037-8c16-5922bfd4a787 service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7164443b-2e24-4a93-b3ef-50a33f67d5d0 req-75719d49-5283-4037-8c16-5922bfd4a787 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7164443b-2e24-4a93-b3ef-50a33f67d5d0 req-75719d49-5283-4037-8c16-5922bfd4a787 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-7164443b-2e24-4a93-b3ef-50a33f67d5d0 req-75719d49-5283-4037-8c16-5922bfd4a787 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:45:10 user nova-compute[74075]: WARNING nova.compute.manager [req-7164443b-2e24-4a93-b3ef-50a33f67d5d0 req-75719d49-5283-4037-8c16-5922bfd4a787 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9266332d-6d4a-4810-ab56-ce5019f74f04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b1e64231-fb6b-40d8-8edf-f91e6993f2da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 3b9a4670-501d-4798-b4f1-fef51995caf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:45:10 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.230s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:11 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-5dff981b-feaa-48ec-9576-e2a408ca45db req-69c347b0-a1d8-4099-af93-73a925766527 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5dff981b-feaa-48ec-9576-e2a408ca45db req-69c347b0-a1d8-4099-af93-73a925766527 service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5dff981b-feaa-48ec-9576-e2a408ca45db req-69c347b0-a1d8-4099-af93-73a925766527 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5dff981b-feaa-48ec-9576-e2a408ca45db req-69c347b0-a1d8-4099-af93-73a925766527 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-5dff981b-feaa-48ec-9576-e2a408ca45db req-69c347b0-a1d8-4099-af93-73a925766527 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:45:12 user nova-compute[74075]: WARNING nova.compute.manager [req-5dff981b-feaa-48ec-9576-e2a408ca45db req-69c347b0-a1d8-4099-af93-73a925766527 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 09:45:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:45:12 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance spawned successfully.
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG nova.objects.instance [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74075) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 09:45:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-562499c4-0c33-4f97-9ec0-be36f1d8fa91 tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.088s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:45:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:28 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b1e64231-fb6b-40d8-8edf-f91e6993f2da is timed out.
Oct 26 09:45:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Successfully detached device vdb from instance b1e64231-fb6b-40d8-8edf-f91e6993f2da from the live domain config.
Oct 26 09:45:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzakGiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:45:28 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:45:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5210b-2bc4-4360-bc2f-930ff9563d5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:45:28 user nova-compute[74075]: No targets found.
Oct 26 09:45:28 user nova-compute[74075]: iSNS:
Oct 26 09:45:28 user nova-compute[74075]: No targets found.
Oct 26 09:45:28 user nova-compute[74075]: STATIC:
Oct 26 09:45:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:45:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980
Oct 26 09:45:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:45:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99
Oct 26 09:45:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:45:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:28 user nova-compute[74075]: FIRMWARE:
Oct 26 09:45:28 user nova-compute[74075]: No targets found.
Oct 26 09:45:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:45:28 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:45:28 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4fa807-d962-444a-834d-5bbc27274f68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc9557f-ccd7-4e38-baca-dd0d722be570]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:45:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 (non-flash)
Oct 26 09:45:29 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:45:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c7d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f4d77-f49e-4867-8334-15c53e726d58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0773e384-132a-404b-b5ad-681c4674093b]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[657ce2ad-dfa0-4905-b2fb-65e0ab4ada90]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fb2817-01c5-4411-91cf-99757b4e5ba2]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb39935-e905-4a23-a49a-edf233c8a4b7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee6c4b-fd8e-4e72-a6a2-3e4cfc7ae3ae]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260]
Oct 26 09:45:29 user nova-compute[74075]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980, portal: 172.16.0.220,3260] successful.
Oct 26 09:45:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c26a8fc-6104-4de2-bcc2-105781868980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6495b2-a4c6-470b-ac4e-d984553e43df]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] <== disconnect_volume: return (335ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:45:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:45:30 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lazy-loading 'flavor' on Instance uuid b1e64231-fb6b-40d8-8edf-f91e6993f2da {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:45:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f0116031-e689-47a3-95c1-b30086432ed4 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.234s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-changed-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Refreshing instance network info cache due to event network-changed-98e149e6-16b9-4b73-b3cb-8db9085814c6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Refreshing network info cache for port 98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updated VIF entry in instance network info cache for port 98e149e6-16b9-4b73-b3cb-8db9085814c6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG nova.network.neutron [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-08f5680b-22a1-46c2-9d7b-6f3cfee295ae req-4840afdc-3a0c-4191-904c-1e386dd554d1 service nova] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Stashing vm_state: active {{(pid=74075) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:45:37 user nova-compute[74075]: INFO nova.compute.claims [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Claim successful on node user
Oct 26 09:45:37 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating resource usage from migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-changed-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Refreshing instance network info cache due to event network-changed-21e585b9-3802-49e4-82f1-0140ea968bc6. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] Acquiring lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] Acquired lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Refreshing network info cache for port 21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.756s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:37 user nova-compute[74075]: INFO nova.compute.manager [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Migrating
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updated VIF entry in instance network info cache for port 21e585b9-3802-49e4-82f1-0140ea968bc6. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-73e28933-202c-4aea-a15d-f41b2f4631c2 req-34daa519-e55f-4e25-a23c-68e6085e3825 service nova] Releasing lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquired lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:37 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Releasing lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Starting migrate_disk_and_power_off {{(pid=74075) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-f042e14f-804b-448f-b3e1-6cfda8ca6239 req-ce4599be-b821-41d5-9b40-d4cf8a35f971 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-unplugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f042e14f-804b-448f-b3e1-6cfda8ca6239 req-ce4599be-b821-41d5-9b40-d4cf8a35f971 service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f042e14f-804b-448f-b3e1-6cfda8ca6239 req-ce4599be-b821-41d5-9b40-d4cf8a35f971 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f042e14f-804b-448f-b3e1-6cfda8ca6239 req-ce4599be-b821-41d5-9b40-d4cf8a35f971 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-f042e14f-804b-448f-b3e1-6cfda8ca6239 req-ce4599be-b821-41d5-9b40-d4cf8a35f971 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-unplugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:45:38 user nova-compute[74075]: WARNING nova.compute.manager [req-f042e14f-804b-448f-b3e1-6cfda8ca6239 req-ce4599be-b821-41d5-9b40-d4cf8a35f971 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-unplugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state active and task_state resize_migrating.
Oct 26 09:45:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance destroyed successfully.
Oct 26 09:45:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-453913386',display_name='tempest-ServerActionsTestOtherA-server-453913386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-453913386',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-5gsnb35x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=ff518f36-defb-4f41-aaf0-9a1e5238a20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21e585b9-38, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d7d89c5-8038-45aa-9da0-834514308b99) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:45:39 user nova-compute[74075]: INFO os_vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38')
Oct 26 09:45:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:45:39 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d94bf76-968b-4540-b678-d663b80b5001]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:45:39 user nova-compute[74075]: No targets found.
Oct 26 09:45:39 user nova-compute[74075]: iSNS:
Oct 26 09:45:39 user nova-compute[74075]: No targets found.
Oct 26 09:45:39 user nova-compute[74075]: STATIC:
Oct 26 09:45:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:45:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:45:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99
Oct 26 09:45:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:45:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:45:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:45:39 user nova-compute[74075]: FIRMWARE:
Oct 26 09:45:39 user nova-compute[74075]: No targets found.
Oct 26 09:45:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:45:39 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:45:39 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b8d639-4033-4067-92d3-7bffb8b6de17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0267b96-b04e-4eb9-9286-3a3da6c8d559]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:39 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:39 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:39 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:45:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:45:39 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:45:39 user nova-compute[74075]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:45:39 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:45:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2935b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc'): ({'sdf'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Removing single pathed devices sdf {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb921e9a-f343-478c-8c58-fc2cbf617e73]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b689ae-a3d5-4ac6-9132-a0532f5d259f]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flushing IO for device /dev/sdf {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca83bc-1318-4f54-bc36-2591458045e9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44c0a98-f94b-49a9-974a-5be7acf28877]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b03c1d-7871-4ae2-b5f3-765ea41040bf]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e1145e-da58-4102-80fb-f32781e73947]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]
Oct 26 09:45:39 user nova-compute[74075]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.
Oct 26 09:45:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cb7790-eccf-4fe8-889c-5e3c920d2b61]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== disconnect_volume: return (336ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:45:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Port 21e585b9-3802-49e4-82f1-0140ea968bc6 binding to destination host user is already ACTIVE {{(pid=74075) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-f75f148a-0cc8-4528-8f02-43c476be55a9 req-a20ae44f-80ac-4ff1-8e49-1e85cfae490a service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f75f148a-0cc8-4528-8f02-43c476be55a9 req-a20ae44f-80ac-4ff1-8e49-1e85cfae490a service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f75f148a-0cc8-4528-8f02-43c476be55a9 req-a20ae44f-80ac-4ff1-8e49-1e85cfae490a service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f75f148a-0cc8-4528-8f02-43c476be55a9 req-a20ae44f-80ac-4ff1-8e49-1e85cfae490a service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-f75f148a-0cc8-4528-8f02-43c476be55a9 req-a20ae44f-80ac-4ff1-8e49-1e85cfae490a service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:45:40 user nova-compute[74075]: WARNING nova.compute.manager [req-f75f148a-0cc8-4528-8f02-43c476be55a9 req-a20ae44f-80ac-4ff1-8e49-1e85cfae490a service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state active and task_state resize_migrating.
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquired lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Releasing lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG os_brick.utils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f4b9e-1095-4619-9450-4a0949420080]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b437052d-7f82-454a-9e78-c0e028d218a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[589b837b-1b30-46dc-8981-42dcff9173b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314b135-d120-41e2-8ebf-dc9335600e3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:45:41 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:45:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[40212459-7cc7-40a8-b21a-f4fb550aeb37]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:45:41 user nova-compute[74075]: DEBUG os_brick.utils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:45:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-changed-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:45:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Refreshing instance network info cache due to event network-changed-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:45:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] Acquiring lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:45:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] Acquired lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:45:49 user nova-compute[74075]: DEBUG nova.network.neutron [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Refreshing network info cache for port 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'flavor' on Instance uuid b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG nova.network.neutron [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updated VIF entry in instance network info cache for port 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG nova.network.neutron [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6205c0e9-b034-4999-857a-a44b8ca9e9ea req-d4bcb8f7-3feb-400b-8605-2b25d389fbab service nova] Releasing lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:45:50 user nova-compute[74075]: INFO nova.compute.manager [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Attaching volume 597aaf37-b889-499d-8ef4-e675b04dbe4f to /dev/vdb
Oct 26 09:45:50 user nova-compute[74075]: DEBUG os_brick.utils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9bfaf2-1ec6-46c5-b833-77a1be404521]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62603a-e515-49ac-87fd-b0b875d47911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e4930-06bc-487d-8bd0-3c688625c627]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8b80db-24e2-49b6-9a1a-0cb3e7d8e4d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:45:51 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:45:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb1a5d-21f4-4c67-9456-7eb46a1f9520]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG os_brick.utils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:45:51 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating existing volume attachment record: dbec62be-da5e-48b2-944c-3d69da447cfc {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:45:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:45:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Starting finish_migration {{(pid=74075) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance directory exists: not creating {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 09:46:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Creating image(s)
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Ensure instance console log exists: /opt/stack/data/nova/instances/ff518f36-defb-4f41-aaf0-9a1e5238a20d/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Start _get_guest_xml network_info=[{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'fdc49d97-5553-402f-ac0d-f7113252f675', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ff518f36-defb-4f41-aaf0-9a1e5238a20d', 'attached_at': '2023-10-26T09:46:01.000000', 'detached_at': '', 'volume_id': '111e0af2-260c-4de2-850a-51224f1d70dc', 'serial': '111e0af2-260c-4de2-850a-51224f1d70dc'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:46:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:46:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:20:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:01 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:01 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:01 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceae5ab-f854-4bc6-bd98-c36964f9b0a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:46:01 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a5bb2e-4541-4bca-ace9-4b5a251f88f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc] added
Oct 26 09:46:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[066f5567-e975-46fe-88d4-ceef8a28cdee]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d46984-0f9b-46be-8ab3-6784b6b16415]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlYitxXZ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlYitxXZ" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f892ca-96e4-4885-8ccc-21c875c5cb5c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlYitxXZ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[61386f52-6c92-4937-89aa-fea2ced04d84]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd9ebf-156c-4223-905c-481ad808e933]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b002ff41-5b44-49a2-bf6f-00eb28e00da7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]
Oct 26 09:46:01 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.
Oct 26 09:46:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ce8f1-7834-4e7b-9205-b51a46eb2e9d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e1ce0-21da-4fc3-87c3-3639ac2edca1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:46:01 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1643080b-4754-46bd-a65a-a339ab90f9b3]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23765646132333737', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765646132333737', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-453913386',display_name='tempest-ServerActionsTestOtherA-server-453913386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-453913386',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-5gsnb35x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=ff518f36-defb-4f41-aaf0-9a1e5238a20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:46:02 user nova-compute[74075]:   <uuid>ff518f36-defb-4f41-aaf0-9a1e5238a20d</uuid>
Oct 26 09:46:02 user nova-compute[74075]:   <name>instance-00000021</name>
Oct 26 09:46:02 user nova-compute[74075]:   <memory>2097152</memory>
Oct 26 09:46:02 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:46:02 user nova-compute[74075]:   <metadata>
Oct 26 09:46:02 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:46:02 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:46:02 user nova-compute[74075]:       <nova:name>tempest-ServerActionsTestOtherA-server-453913386</nova:name>
Oct 26 09:46:02 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:46:01</nova:creationTime>
Oct 26 09:46:02 user nova-compute[74075]:       <nova:flavor name="m1.small">
Oct 26 09:46:02 user nova-compute[74075]:         <nova:memory>2048</nova:memory>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:disk>20</nova:disk>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:46:02 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:46:02 user nova-compute[74075]:       <nova:owner>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:user uuid="729f5d24fc714c65b3c1a811e5cdf271">tempest-ServerActionsTestOtherA-546437878-project-member</nova:user>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:project uuid="7a627b8e169d4a97b075f16e150d972f">tempest-ServerActionsTestOtherA-546437878</nova:project>
Oct 26 09:46:02 user nova-compute[74075]:       </nova:owner>
Oct 26 09:46:02 user nova-compute[74075]:       <nova:ports>
Oct 26 09:46:02 user nova-compute[74075]:         <nova:port uuid="21e585b9-3802-49e4-82f1-0140ea968bc6">
Oct 26 09:46:02 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:46:02 user nova-compute[74075]:         </nova:port>
Oct 26 09:46:02 user nova-compute[74075]:       </nova:ports>
Oct 26 09:46:02 user nova-compute[74075]:     </nova:instance>
Oct 26 09:46:02 user nova-compute[74075]:   </metadata>
Oct 26 09:46:02 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:46:02 user nova-compute[74075]:     <system>
Oct 26 09:46:02 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:46:02 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:46:02 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:46:02 user nova-compute[74075]:       <entry name="serial">ff518f36-defb-4f41-aaf0-9a1e5238a20d</entry>
Oct 26 09:46:02 user nova-compute[74075]:       <entry name="uuid">ff518f36-defb-4f41-aaf0-9a1e5238a20d</entry>
Oct 26 09:46:02 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:46:02 user nova-compute[74075]:     </system>
Oct 26 09:46:02 user nova-compute[74075]:   </sysinfo>
Oct 26 09:46:02 user nova-compute[74075]:   <os>
Oct 26 09:46:02 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:46:02 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:46:02 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:46:02 user nova-compute[74075]:   </os>
Oct 26 09:46:02 user nova-compute[74075]:   <features>
Oct 26 09:46:02 user nova-compute[74075]:     <acpi/>
Oct 26 09:46:02 user nova-compute[74075]:     <apic/>
Oct 26 09:46:02 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:46:02 user nova-compute[74075]:   </features>
Oct 26 09:46:02 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:46:02 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:46:02 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:46:02 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:46:02 user nova-compute[74075]:   </clock>
Oct 26 09:46:02 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:46:02 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:46:02 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:46:02 user nova-compute[74075]:   </cpu>
Oct 26 09:46:02 user nova-compute[74075]:   <devices>
Oct 26 09:46:02 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:46:02 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:02 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:46:02 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:46:02 user nova-compute[74075]:       <serial>111e0af2-260c-4de2-850a-51224f1d70dc</serial>
Oct 26 09:46:02 user nova-compute[74075]:     </disk>
Oct 26 09:46:02 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:46:02 user nova-compute[74075]:       <mac address="fa:16:3e:2f:52:55"/>
Oct 26 09:46:02 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:46:02 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:46:02 user nova-compute[74075]:       <target dev="tap21e585b9-38"/>
Oct 26 09:46:02 user nova-compute[74075]:     </interface>
Oct 26 09:46:02 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:46:02 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/ff518f36-defb-4f41-aaf0-9a1e5238a20d/console.log" append="off"/>
Oct 26 09:46:02 user nova-compute[74075]:     </serial>
Oct 26 09:46:02 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:46:02 user nova-compute[74075]:     <video>
Oct 26 09:46:02 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:46:02 user nova-compute[74075]:     </video>
Oct 26 09:46:02 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:46:02 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:46:02 user nova-compute[74075]:     </rng>
Oct 26 09:46:02 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:46:02 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:46:02 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:46:02 user nova-compute[74075]:     </memballoon>
Oct 26 09:46:02 user nova-compute[74075]:   </devices>
Oct 26 09:46:02 user nova-compute[74075]: </domain>
Oct 26 09:46:02 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-453913386',display_name='tempest-ServerActionsTestOtherA-server-453913386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-453913386',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-5gsnb35x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=ff518f36-defb-4f41-aaf0-9a1e5238a20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1804863781-network", "vif_mac": "fa:16:3e:2f:52:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG os_vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1903d101-6fb4-58a7-8ead-e3b72a105db8', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21e585b9-38, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21e585b9-38, col_values=(('qos', UUID('4bcefa91-64a8-4c32-97d2-1c895dc88301')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21e585b9-38, col_values=(('external_ids', {'iface-id': '21e585b9-3802-49e4-82f1-0140ea968bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:52:55', 'vm-uuid': 'ff518f36-defb-4f41-aaf0-9a1e5238a20d'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:02 user nova-compute[74075]: INFO os_vif [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38')
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:46:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] No VIF found with MAC fa:16:3e:2f:52:55, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:46:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG nova.compute.manager [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-changed-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG nova.compute.manager [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Refreshing instance network info cache due to event network-changed-8c3aaaba-6b7d-4ae2-abff-8fae61e21732. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] Acquiring lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] Acquired lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Refreshing network info cache for port 8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updated VIF entry in instance network info cache for port 8c3aaaba-6b7d-4ae2-abff-8fae61e21732. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updating instance_info_cache with network_info: [{"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-d2584c82-6c6c-4e32-8c0e-912c7eecdb11 req-78225906-bead-400c-b58e-1e986980be3c service nova] Releasing lock "refresh_cache-3b9a4670-501d-4798-b4f1-fef51995caf2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:46:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:06 user nova-compute[74075]: WARNING nova.compute.manager [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state active and task_state resize_finish.
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:06 user nova-compute[74075]: WARNING nova.compute.manager [req-6df1eb1c-c521-440d-bd15-0d850cb4bdca req-6ac15d13-190b-4127-be58-604f146a35ef service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state active and task_state resize_finish.
Oct 26 09:46:06 user nova-compute[74075]: INFO nova.compute.manager [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Unrescuing
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquired lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:46:06 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance running successfully.
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Failed to set time: agent not configured {{(pid=74075) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-dd811399-189d-4d82-9aa4-7b9a1afa1898 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] finish_migration finished successfully. {{(pid=74075) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updating instance_info_cache with network_info: [{"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Releasing lock "refresh_cache-9266332d-6d4a-4810-ab56-ce5019f74f04" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG nova.objects.instance [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'flavor' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-3d49079e-cc30-4025-bbf6-1733917c0f3c req-aeb69cf2-0fa8-40e6-bb36-46a537700366 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3d49079e-cc30-4025-bbf6-1733917c0f3c req-aeb69cf2-0fa8-40e6-bb36-46a537700366 service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3d49079e-cc30-4025-bbf6-1733917c0f3c req-aeb69cf2-0fa8-40e6-bb36-46a537700366 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3d49079e-cc30-4025-bbf6-1733917c0f3c req-aeb69cf2-0fa8-40e6-bb36-46a537700366 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-3d49079e-cc30-4025-bbf6-1733917c0f3c req-aeb69cf2-0fa8-40e6-bb36-46a537700366 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:07 user nova-compute[74075]: WARNING nova.compute.manager [req-3d49079e-cc30-4025-bbf6-1733917c0f3c req-aeb69cf2-0fa8-40e6-bb36-46a537700366 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:46:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance destroyed successfully.
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-9d057a19-2c36-4618-aa47-d1d3bb2305cf req-9ee502d3-0d7d-428f-93bd-1f889b1e9add service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9d057a19-2c36-4618-aa47-d1d3bb2305cf req-9ee502d3-0d7d-428f-93bd-1f889b1e9add service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9d057a19-2c36-4618-aa47-d1d3bb2305cf req-9ee502d3-0d7d-428f-93bd-1f889b1e9add service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9d057a19-2c36-4618-aa47-d1d3bb2305cf req-9ee502d3-0d7d-428f-93bd-1f889b1e9add service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-9d057a19-2c36-4618-aa47-d1d3bb2305cf req-9ee502d3-0d7d-428f-93bd-1f889b1e9add service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:12 user nova-compute[74075]: WARNING nova.compute.manager [req-9d057a19-2c36-4618-aa47-d1d3bb2305cf req-9ee502d3-0d7d-428f-93bd-1f889b1e9add service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:12 user nova-compute[74075]: WARNING nova.compute.manager [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:12 user nova-compute[74075]: WARNING nova.compute.manager [req-9862a7f7-b4b1-4fc0-931a-3c9a2671f424 req-be8d27a3-47a3-471c-8889-3280653b17ec service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state rescued and task_state unrescuing.
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7a289f62-b5af-43a1-a6b2-e058879d8c60 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:46:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.132434844970703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid 3b9a4670-501d-4798-b4f1-fef51995caf2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:12 user nova-compute[74075]: INFO nova.compute.manager [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Terminating instance
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Applying migration context for instance ff518f36-defb-4f41-aaf0-9a1e5238a20d as it has an incoming, in-progress migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21. Migration status is finished {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 09:46:12 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating resource usage from migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21
Oct 26 09:46:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9266332d-6d4a-4810-ab56-ce5019f74f04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b1e64231-fb6b-40d8-8edf-f91e6993f2da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 3b9a4670-501d-4798-b4f1-fef51995caf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: INFO nova.compute.manager [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Attaching volume d6575333-7912-4bb1-9318-2c5244a4c523 to /dev/vdb
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-28cd799f-54a8-4998-afce-c70bef9bb143 req-907d98c5-4a85-4348-b41c-87bf5188363f service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-vif-unplugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-28cd799f-54a8-4998-afce-c70bef9bb143 req-907d98c5-4a85-4348-b41c-87bf5188363f service nova] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-28cd799f-54a8-4998-afce-c70bef9bb143 req-907d98c5-4a85-4348-b41c-87bf5188363f service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-28cd799f-54a8-4998-afce-c70bef9bb143 req-907d98c5-4a85-4348-b41c-87bf5188363f service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-28cd799f-54a8-4998-afce-c70bef9bb143 req-907d98c5-4a85-4348-b41c-87bf5188363f service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] No waiting events found dispatching network-vif-unplugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-28cd799f-54a8-4998-afce-c70bef9bb143 req-907d98c5-4a85-4348-b41c-87bf5188363f service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-vif-unplugged-3ac366dd-deee-4116-bc3c-a22a05450676 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG os_brick.utils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee09c42-8eb8-44c6-a7e3-a1f0965915c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[affffa72-ab90-4999-905f-80e90c1fcb40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[de57a065-e820-42d2-9fd8-a48a34436520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e9911a-eba7-4b26-9a0f-4bb405f1e29a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:46:12 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:46:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8853cc-d34c-4202-b714-a3fc8c2f509e]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG os_brick.utils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updating existing volume attachment record: ae582ed2-a715-426d-ad46-6bd623df5403 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:46:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:46:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Instance destroyed successfully.
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lazy-loading 'resources' on Instance uuid b1e64231-fb6b-40d8-8edf-f91e6993f2da {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-305078431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3050784',id=32,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiAxj8HILZoj9TzxOBDO8aLSJSlFTDO38Wje36X8U+dnJ8OeaXZQZYgVtWf1qzSXS6OUr1WOFEHUzWzS5UiA4DxIdRauWua4zzvGX9ZZpbnj3U2pzc442mBzdxrC2ByHQ==',key_name='tempest-keypair-2121053291',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db4dadbf57244875abb469e5bf240471',ramdisk_id='',reservation_id='r-5zk0tg83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-368946537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25a0123b730f4a6d9b8e6bf15fd5727b',uuid=b1e64231-fb6b-40d8-8edf-f91e6993f2da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Converting VIF {"id": "3ac366dd-deee-4116-bc3c-a22a05450676", "address": "fa:16:3e:7f:3a:38", "network": {"id": "ddbf065b-e528-4835-b024-472491865b45", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1772121176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db4dadbf57244875abb469e5bf240471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac366dd-de", "ovs_interfaceid": "3ac366dd-deee-4116-bc3c-a22a05450676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG os_vif [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ac366dd-de, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.922s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bfe5ad8-22a4-4ab7-ad07-cd32af5972bb) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:46:13 user nova-compute[74075]: INFO os_vif [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:3a:38,bridge_name='br-int',has_traffic_filtering=True,id=3ac366dd-deee-4116-bc3c-a22a05450676,network=Network(ddbf065b-e528-4835-b024-472491865b45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac366dd-de')
Oct 26 09:46:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Deleting instance files /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da_del
Oct 26 09:46:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Deletion of /opt/stack/data/nova/instances/b1e64231-fb6b-40d8-8edf-f91e6993f2da_del complete
Oct 26 09:46:13 user nova-compute[74075]: INFO nova.compute.manager [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 09:46:13 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:46:13 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:46:14 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Took 0.95 seconds to deallocate network for instance.
Oct 26 09:46:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-512b8760-260e-48a9-a93e-acbb2f803e40 req-ad5fd071-5a58-4580-a07a-815ea4633f33 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-vif-deleted-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-bffbab88-294b-4feb-81e7-dd3afb422d29 req-b21516ab-9907-4fd7-bc9d-196b3bff8966 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received event network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bffbab88-294b-4feb-81e7-dd3afb422d29 req-b21516ab-9907-4fd7-bc9d-196b3bff8966 service nova] Acquiring lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bffbab88-294b-4feb-81e7-dd3afb422d29 req-b21516ab-9907-4fd7-bc9d-196b3bff8966 service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bffbab88-294b-4feb-81e7-dd3afb422d29 req-b21516ab-9907-4fd7-bc9d-196b3bff8966 service nova] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-bffbab88-294b-4feb-81e7-dd3afb422d29 req-b21516ab-9907-4fd7-bc9d-196b3bff8966 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] No waiting events found dispatching network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:14 user nova-compute[74075]: WARNING nova.compute.manager [req-bffbab88-294b-4feb-81e7-dd3afb422d29 req-b21516ab-9907-4fd7-bc9d-196b3bff8966 service nova] [instance: b1e64231-fb6b-40d8-8edf-f91e6993f2da] Received unexpected event network-vif-plugged-3ac366dd-deee-4116-bc3c-a22a05450676 for instance with vm_state deleted and task_state None.
Oct 26 09:46:14 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:46:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.604s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:14 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Deleted allocations for instance b1e64231-fb6b-40d8-8edf-f91e6993f2da
Oct 26 09:46:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a4356abb-bf7e-4d04-b3db-f39b5aad9ea1 tempest-TestServerVolumeAttachScenarioOldVersion-368946537 tempest-TestServerVolumeAttachScenarioOldVersion-368946537-project-member] Lock "b1e64231-fb6b-40d8-8edf-f91e6993f2da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.185s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:46:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [{"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-8b522482-66ab-4ae4-b851-9e4b74433fe6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:46:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:18 user nova-compute[74075]: INFO nova.compute.manager [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Terminating instance
Oct 26 09:46:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-2397b226-8e60-41c0-bdd5-afebe3acdeed req-816e37ab-4df1-4272-a027-0117253135ce service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-unplugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2397b226-8e60-41c0-bdd5-afebe3acdeed req-816e37ab-4df1-4272-a027-0117253135ce service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2397b226-8e60-41c0-bdd5-afebe3acdeed req-816e37ab-4df1-4272-a027-0117253135ce service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2397b226-8e60-41c0-bdd5-afebe3acdeed req-816e37ab-4df1-4272-a027-0117253135ce service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-2397b226-8e60-41c0-bdd5-afebe3acdeed req-816e37ab-4df1-4272-a027-0117253135ce service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-unplugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-2397b226-8e60-41c0-bdd5-afebe3acdeed req-816e37ab-4df1-4272-a027-0117253135ce service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-unplugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:18 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Instance destroyed successfully.
Oct 26 09:46:18 user nova-compute[74075]: DEBUG nova.objects.instance [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lazy-loading 'resources' on Instance uuid d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1877626846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1300777303',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcZZIk2zkIUHPsS9BD3ltrXs4U9SqHpluFWoqb38Y95MCbCzTgDQkxmAk8sPH3FUSm5DJiVkedmeVlU3VVlSSY/szljLnpPnKTnzG0bacZSENTaw60o5HK5qMlAK72tGg==',key_name='tempest-keypair-1526605894',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:45:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f136d23306b64c14a4d7433fbcc1ce47',ramdisk_id='',reservation_id='r-dirbl4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1238912120',owner_user_name='tempest-ServerActionsV293TestJSON-1238912120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:45:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe323ea95a554c1cbb5d689cbe32a993',uuid=d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converting VIF {"id": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "address": "fa:16:3e:6e:de:ad", "network": {"id": "8fe0561c-8f25-4cbb-a697-3ad940be3787", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1528935123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136d23306b64c14a4d7433fbcc1ce47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e121e6c-a8", "ovs_interfaceid": "9e121e6c-a896-4eea-81ea-c2a22a7fbec1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_vif [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e121e6c-a8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91cb3b82-797a-409f-a979-c7d29af012ee) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:46:19 user nova-compute[74075]: INFO os_vif [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:de:ad,bridge_name='br-int',has_traffic_filtering=True,id=9e121e6c-a896-4eea-81ea-c2a22a7fbec1,network=Network(8fe0561c-8f25-4cbb-a697-3ad940be3787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e121e6c-a8')
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMySXkFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:19 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ff512d-a5ff-427c-90d8-30226daca0e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:46:19 user nova-compute[74075]: No targets found.
Oct 26 09:46:19 user nova-compute[74075]: iSNS:
Oct 26 09:46:19 user nova-compute[74075]: No targets found.
Oct 26 09:46:19 user nova-compute[74075]: STATIC:
Oct 26 09:46:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:46:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:46:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99
Oct 26 09:46:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:46:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:19 user nova-compute[74075]: FIRMWARE:
Oct 26 09:46:19 user nova-compute[74075]: No targets found.
Oct 26 09:46:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:46:19 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:46:19 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[990344b4-7971-440c-878e-fd72ec62b8dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aac4ca-ea4d-417e-bf85-ebe01417fa7e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:19 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:19 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:46:19 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:19 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:19 user nova-compute[74075]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 (non-flash)
Oct 26 09:46:19 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c626830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99'): ({'sdg'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Removing single pathed devices sdg {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc474e8-54a9-49a5-9bea-d20e388fa154]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a4ac8-bf35-4c84-a1e3-6b9a85868993]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Flushing IO for device /dev/sdg {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7df71bd-fcc5-4c5e-8340-6bbc57f9967d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dcc999-7dbd-4397-9123-6b8396c0fdb2]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] SCSI volumes sdg have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_55ffd439', '/dev/disk/by-id/scsi-1SCST_BIO55ffd439-f06d108e94c5c3f0', '/dev/disk/by-id/scsi-26630366431303865') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a8e5d5-8410-4e01-9b8f-294db57141eb]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.072s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eefafe4-1360-41fe-823d-da2454d04e6d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c11f70-ab26-4095-9c5b-0be9123202d4]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260]
Oct 26 09:46:19 user nova-compute[74075]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99, portal: 172.16.0.220,3260] successful.
Oct 26 09:46:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4e9783-ce94-43d1-b719-fff64f2b4b99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[adefae29-b275-4d49-8d1f-e27b19752e60]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] <== disconnect_volume: return (466ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:46:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Deleting instance files /opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e_del
Oct 26 09:46:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Deletion of /opt/stack/data/nova/instances/d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e_del complete
Oct 26 09:46:19 user nova-compute[74075]: INFO nova.compute.manager [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 26 09:46:19 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:46:19 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:46:20 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:46:20 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Took 0.81 seconds to deallocate network for instance.
Oct 26 09:46:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-5273bb5c-595f-45a6-ba6b-a2c810317fb5 req-f74f3506-ef5f-4956-a497-5616c987da8a service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-deleted-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a646fe72-f42a-479d-80be-eb1069cd3937 req-a94d6a08-17b2-4105-a31d-935583dd3231 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a646fe72-f42a-479d-80be-eb1069cd3937 req-a94d6a08-17b2-4105-a31d-935583dd3231 service nova] Acquiring lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a646fe72-f42a-479d-80be-eb1069cd3937 req-a94d6a08-17b2-4105-a31d-935583dd3231 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a646fe72-f42a-479d-80be-eb1069cd3937 req-a94d6a08-17b2-4105-a31d-935583dd3231 service nova] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a646fe72-f42a-479d-80be-eb1069cd3937 req-a94d6a08-17b2-4105-a31d-935583dd3231 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] No waiting events found dispatching network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:46:20 user nova-compute[74075]: WARNING nova.compute.manager [req-a646fe72-f42a-479d-80be-eb1069cd3937 req-a94d6a08-17b2-4105-a31d-935583dd3231 service nova] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Received unexpected event network-vif-plugged-9e121e6c-a896-4eea-81ea-c2a22a7fbec1 for instance with vm_state active and task_state deleting.
Oct 26 09:46:21 user nova-compute[74075]: INFO nova.compute.manager [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Took 0.97 seconds to detach 1 volumes for instance.
Oct 26 09:46:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] [instance: d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e] Deleting volume: fc4e9783-ce94-43d1-b719-fff64f2b4b99 {{(pid=74075) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 09:46:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:22 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:46:22 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:46:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:22 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Deleted allocations for instance d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e
Oct 26 09:46:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7c6c24f0-ee3a-4e9d-9fda-13a7b5d1d4ee tempest-ServerActionsV293TestJSON-1238912120 tempest-ServerActionsV293TestJSON-1238912120-project-member] Lock "d6bdbf33-cb85-4cc8-9bff-cf65d1b9a57e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.980s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NwMxQmFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:25 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:25 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:25 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a6b4c-438c-4b6a-b93f-84584f63be31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:46:25 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedaf60c-a56b-4c2f-b1a5-e87953081aec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f] added
Oct 26 09:46:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb7710-ea6a-4295-a74f-530f09e888d3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1fb5a8-487a-4ad9-bd5b-976b996b39bc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NwMxQmFg {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NwMxQmFg" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8e7a7-e96f-47ec-bd96-adb120ce0d54]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NwMxQmFg'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[04749cf8-fa50-40d1-8258-6d430dccbb34]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec78333e-4096-4b08-af28-d4c7ca3b5945]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7776fe-7fe4-4496-bf99-a93eeafae3fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260]
Oct 26 09:46:25 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260] successful.
Oct 26 09:46:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1e5cb7-2eaa-4b18-a99c-b656f3e46dcd]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe3bcd-1e4b-4edc-9e7e-d63ec972bf51]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:25 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:25 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.041s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb08f37-37aa-46ee-bab6-9416e6fd406a]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:46:25 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NwMxQmFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:46:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26138353035376266', 'path': '/dev/sde'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138353035376266', 'path': '/dev/sde'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:46:26 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'flavor' on Instance uuid b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:46:26 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:26 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:46:26 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:46:26 user nova-compute[74075]:   <serial>597aaf37-b889-499d-8ef4-e675b04dbe4f</serial>
Oct 26 09:46:26 user nova-compute[74075]: </disk>
Oct 26 09:46:26 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:46:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:46:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:46:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No VIF found with MAC fa:16:3e:5f:fa:31, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:46:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d6e146ea-e47e-4a4c-a38a-690fca748922 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.371s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:30 user nova-compute[74075]: INFO nova.compute.manager [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Detaching volume 597aaf37-b889-499d-8ef4-e675b04dbe4f
Oct 26 09:46:30 user nova-compute[74075]: INFO nova.virt.block_device [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Attempting to driver detach volume 597aaf37-b889-499d-8ef4-e675b04dbe4f from mountpoint /dev/vdb
Oct 26 09:46:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Attempting to detach device vdb from instance b73b245a-454a-4082-87e1-2f759341a7a7 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:46:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:46:30 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:30 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:46:30 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:46:30 user nova-compute[74075]:   <serial>597aaf37-b889-499d-8ef4-e675b04dbe4f</serial>
Oct 26 09:46:30 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:46:30 user nova-compute[74075]: </disk>
Oct 26 09:46:30 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:46:30 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully detached device vdb from instance b73b245a-454a-4082-87e1-2f759341a7a7 from the persistent domain config.
Oct 26 09:46:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b73b245a-454a-4082-87e1-2f759341a7a7 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:46:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:46:30 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:30 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:46:30 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:46:30 user nova-compute[74075]:   <serial>597aaf37-b889-499d-8ef4-e675b04dbe4f</serial>
Oct 26 09:46:30 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:46:30 user nova-compute[74075]: </disk>
Oct 26 09:46:30 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:46:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:46:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWEAUNiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:33 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:33 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:33 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c476664-5f6b-48c6-a4e6-aa03ca7b1d6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:46:33 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cacbd25-6e92-466f-acce-f669f2b5ef3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523] added
Oct 26 09:46:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5631e2c-d14d-4525-b3b7-878d6096b060]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe2ef2-1f0f-403f-b345-6651011a555b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWEAUNiu {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWEAUNiu" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a93001-6ae2-40f6-b675-972b887c2267]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yWEAUNiu'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13890e6-b637-46ae-8458-a0eb2b63c11b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db50fe-cb89-4f3e-a87d-3a7e77ecfb44]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:33 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:33 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:33 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:33 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:33 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:33 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd335dd7-4de7-4bdb-b3ec-6e0dbcb86662]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:33 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260]
Oct 26 09:46:33 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260] successful.
Oct 26 09:46:33 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1adb0c-f0f9-4311-839b-dd83b0e80795]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef23c687-0ec1-4abc-863f-d057109f6e45]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)
Oct 26 09:46:34 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:34 user nova-compute[74075]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)
Oct 26 09:46:34 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb6e355-d23e-4e24-8f79-fc423f7bc92b]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:46:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWEAUNiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23438636237386132', 'path': '/dev/sdf'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438636237386132', 'path': '/dev/sdf'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid 3b9a4670-501d-4798-b4f1-fef51995caf2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:46:35 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:35 user nova-compute[74075]:   <source dev="/dev/sdf"/>
Oct 26 09:46:35 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:46:35 user nova-compute[74075]:   <serial>d6575333-7912-4bb1-9318-2c5244a4c523</serial>
Oct 26 09:46:35 user nova-compute[74075]: </disk>
Oct 26 09:46:35 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] No VIF found with MAC fa:16:3e:23:81:26, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:46:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8f68911d-72e7-4159-91c0-0334ea53d157 tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.262s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:36 user nova-compute[74075]: INFO nova.compute.manager [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Detaching volume d6575333-7912-4bb1-9318-2c5244a4c523
Oct 26 09:46:36 user nova-compute[74075]: INFO nova.virt.block_device [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Attempting to driver detach volume d6575333-7912-4bb1-9318-2c5244a4c523 from mountpoint /dev/vdb
Oct 26 09:46:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Attempting to detach device vdb from instance 3b9a4670-501d-4798-b4f1-fef51995caf2 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:46:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:46:36 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:36 user nova-compute[74075]:   <source dev="/dev/sdf"/>
Oct 26 09:46:36 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:46:36 user nova-compute[74075]:   <serial>d6575333-7912-4bb1-9318-2c5244a4c523</serial>
Oct 26 09:46:36 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:46:36 user nova-compute[74075]: </disk>
Oct 26 09:46:36 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:46:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully detached device vdb from instance 3b9a4670-501d-4798-b4f1-fef51995caf2 from the persistent domain config.
Oct 26 09:46:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b9a4670-501d-4798-b4f1-fef51995caf2 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:46:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:46:36 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:46:36 user nova-compute[74075]:   <source dev="/dev/sdf"/>
Oct 26 09:46:36 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:46:36 user nova-compute[74075]:   <serial>d6575333-7912-4bb1-9318-2c5244a4c523</serial>
Oct 26 09:46:36 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:46:36 user nova-compute[74075]: </disk>
Oct 26 09:46:36 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:46:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b9a4670-501d-4798-b4f1-fef51995caf2 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:46:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b73b245a-454a-4082-87e1-2f759341a7a7 is timed out.
Oct 26 09:46:50 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully detached device vdb from instance b73b245a-454a-4082-87e1-2f759341a7a7 from the live domain config.
Oct 26 09:46:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NwMxQmFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:50 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[993a79f8-4da6-44ee-95db-ed7edf2d09d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:46:50 user nova-compute[74075]: No targets found.
Oct 26 09:46:50 user nova-compute[74075]: iSNS:
Oct 26 09:46:50 user nova-compute[74075]: No targets found.
Oct 26 09:46:50 user nova-compute[74075]: STATIC:
Oct 26 09:46:50 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:46:50 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:50 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:50 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f
Oct 26 09:46:50 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:50 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:50 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523
Oct 26 09:46:50 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:50 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:50 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:46:50 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:50 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:50 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:46:50 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:50 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:50 user nova-compute[74075]: FIRMWARE:
Oct 26 09:46:50 user nova-compute[74075]: No targets found.
Oct 26 09:46:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:46:50 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:46:50 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89a1779-bdad-499d-a473-f7a6183b83d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc46400-b587-4eb1-b79e-acd3eb9f384f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)
Oct 26 09:46:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f (non-flash)
Oct 26 09:46:50 user nova-compute[74075]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)
Oct 26 09:46:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f'): ({'sde'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Removing single pathed devices sde {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba371ef8-60d3-4d0c-9c6b-afe2ae2565de]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[60befe22-98ce-47b7-a070-c562edb4e9d4]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Flushing IO for device /dev/sde {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f4d051-45a8-4551-b24e-23f6504b4b42]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b08470-89ff-4c42-bd87-631501d0878f]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e304eb-0e43-44eb-85dc-75caa4b3028b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[37418a30-e924-4376-aeb7-dd11fe12c4cd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260]
Oct 26 09:46:50 user nova-compute[74075]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f, portal: 172.16.0.220,3260] successful.
Oct 26 09:46:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597aaf37-b889-499d-8ef4-e675b04dbe4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d408df-d753-4fff-a21f-a399997a0d2c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] <== disconnect_volume: return (381ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-changed-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Refreshing instance network info cache due to event network-changed-87db5054-6998-4feb-92a9-ce407ec5728e. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] Acquiring lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] Acquired lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Refreshing network info cache for port 87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updated VIF entry in instance network info cache for port 87db5054-6998-4feb-92a9-ce407ec5728e. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.network.neutron [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating instance_info_cache with network_info: [{"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cd0e3a79-2a1f-4143-8a13-5707469cc5d6 req-1694531e-7d9d-47ae-bdfa-e0fb6b73047a service nova] Releasing lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'flavor' on Instance uuid b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c9276c6d-401f-450f-9d0f-13ba5fc7a9da tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:57 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b9a4670-501d-4798-b4f1-fef51995caf2 is timed out.
Oct 26 09:46:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully detached device vdb from instance 3b9a4670-501d-4798-b4f1-fef51995caf2 from the live domain config.
Oct 26 09:46:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWEAUNiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:57 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ec63c-9ec0-4432-b3e3-5e59c8c7e373]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:46:57 user nova-compute[74075]: No targets found.
Oct 26 09:46:57 user nova-compute[74075]: iSNS:
Oct 26 09:46:57 user nova-compute[74075]: No targets found.
Oct 26 09:46:57 user nova-compute[74075]: STATIC:
Oct 26 09:46:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:46:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523
Oct 26 09:46:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:46:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:57 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:46:57 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:46:57 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:46:57 user nova-compute[74075]: FIRMWARE:
Oct 26 09:46:57 user nova-compute[74075]: No targets found.
Oct 26 09:46:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:46:57 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:46:57 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71de92b-d4aa-4402-8a58-3eb8886e46a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8197f6-d24d-4f6a-a931-a3442d0147a7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:57 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:57 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:57 user nova-compute[74075]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)
Oct 26 09:46:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:46:57 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:46:57 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:46:57 user nova-compute[74075]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 (non-flash)
Oct 26 09:46:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c627640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523'): ({'sdf'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Removing single pathed devices sdf {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce01f8-6477-4965-a3cb-2eaacd310eb2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d9798-80d1-4573-bd50-025e0c99cf32]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Flushing IO for device /dev/sdf {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[92623ec4-de38-4196-aae9-437e3e1d18e4]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be6b1e-887a-461c-b9ae-2da8139faa98]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] SCSI volumes sdf have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339c365-29e2-4ddf-a4ad-b8b6098b70dc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7bedb-f129-4903-86c1-60f12b68dbcc]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260]
Oct 26 09:46:57 user nova-compute[74075]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523, portal: 172.16.0.220,3260] successful.
Oct 26 09:46:57 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6575333-7912-4bb1-9318-2c5244a4c523 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a387440-20a9-4f75-9ad2-f6e39c264381]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] <== disconnect_volume: return (282ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'flavor' on Instance uuid 3b9a4670-501d-4798-b4f1-fef51995caf2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:46:58 user nova-compute[74075]: INFO nova.compute.manager [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attaching volume 25cce109-d037-449e-854b-fb1d85c7a80a to /dev/vdb
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-68d1f886-48c1-4d5d-a8f8-9933b42d02de tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7010294c-2b56-490e-9718-b9322f3a00c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[252f5f52-806c-47b3-9848-7da01904c167]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[825026fe-d803-4c1f-893b-2371b672ec89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7866bb-bbb8-469c-a02b-557d30067778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:46:58 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:46:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fea7c60-fdc1-4c08-b494-50a056034b43]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:46:58 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating existing volume attachment record: 7d862055-1656-449c-90e8-ee254ece1136 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:46:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:47:06 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:47:08 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:47:08 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7718MB free_disk=25.149105072021484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Applying migration context for instance ff518f36-defb-4f41-aaf0-9a1e5238a20d as it has an incoming, in-progress migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21. Migration status is finished {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 09:47:08 user nova-compute[74075]: INFO nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating resource usage from migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9266332d-6d4a-4810-ab56-ce5019f74f04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 3b9a4670-501d-4798-b4f1-fef51995caf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:47:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:47:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:47:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:47:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:47:10 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Updating instance_info_cache with network_info: [{"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-668b12c1-9874-472a-88ca-f6671d6a4ba6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:47:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:47:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:47:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:47:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:47:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAWpCVjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:47:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:47:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:47:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:47:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:47:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:47:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:47:17 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:47:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c5b8d6-25c0-4a4f-8231-e33c1e3e5cb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:47:18 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a813a-3f32-4f2f-836a-f9b15315e5ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a] added
Oct 26 09:47:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd0773-1243-403f-bf48-424d4d455b44]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d5bb9-0c0e-4aec-b69c-9ce9c1259806]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uAWpCVjz {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uAWpCVjz" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be2715-8c87-4a70-b247-f7829c2774ee]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uAWpCVjz'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1478b9-e2c9-4925-a751-1b0dd481e2c9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f96e159-9472-4704-a1d5-74b2de60a43b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:47:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:47:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8c3fc-dac6-4745-a8cc-e3530a241a0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260]
Oct 26 09:47:18 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260] successful.
Oct 26 09:47:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af07c24-01d7-482c-a8c7-10610eeb090c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec61fa6-7520-4978-a561-c59d98566355]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)
Oct 26 09:47:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:47:18 user nova-compute[74075]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)
Oct 26 09:47:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e63343-7beb-4a63-993d-d930c89763d0]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAWpCVjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:47:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23736343332653663', 'path': '/dev/sde'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736343332653663', 'path': '/dev/sde'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:47:19 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:47:19 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:47:19 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:47:19 user nova-compute[74075]:   <serial>25cce109-d037-449e-854b-fb1d85c7a80a</serial>
Oct 26 09:47:19 user nova-compute[74075]: </disk>
Oct 26 09:47:19 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:47:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No VIF found with MAC fa:16:3e:7b:13:18, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:47:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4a9213e2-18af-416f-82ee-1047d832864c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.486s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:24 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:47:24 user nova-compute[74075]: INFO nova.compute.claims [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Claim successful on node user
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:47:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:47:25 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:47:25 user nova-compute[74075]: DEBUG nova.policy [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd292ea326cf940beb182512cf6824950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28294d57b6c04f64a6b8e97f11e95389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:47:26 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Creating image(s)
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "/opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "/opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "/opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.189s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk 1073741824" returned: 0 in 0.056s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.260s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Successfully created port: 24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Going to confirm migration 2 {{(pid=74075) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Cannot resize image /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Ensure instance console log exists: /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquired lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'info_cache' on Instance uuid ff518f36-defb-4f41-aaf0-9a1e5238a20d {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:27 user nova-compute[74075]: INFO nova.compute.manager [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Terminating instance
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-4d96a83b-45df-4303-8e4e-3199a79881ce req-21c0d365-7752-4383-bfa1-92499a358266 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-vif-unplugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4d96a83b-45df-4303-8e4e-3199a79881ce req-21c0d365-7752-4383-bfa1-92499a358266 service nova] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4d96a83b-45df-4303-8e4e-3199a79881ce req-21c0d365-7752-4383-bfa1-92499a358266 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4d96a83b-45df-4303-8e4e-3199a79881ce req-21c0d365-7752-4383-bfa1-92499a358266 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-4d96a83b-45df-4303-8e4e-3199a79881ce req-21c0d365-7752-4383-bfa1-92499a358266 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] No waiting events found dispatching network-vif-unplugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-4d96a83b-45df-4303-8e4e-3199a79881ce req-21c0d365-7752-4383-bfa1-92499a358266 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-vif-unplugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:47:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Successfully updated port: 24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquired lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-changed-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Refreshing instance network info cache due to event network-changed-24efb4af-953d-40b6-abdd-a7c2c381941a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] Acquiring lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [{"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Releasing lock "refresh_cache-ff518f36-defb-4f41-aaf0-9a1e5238a20d" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.objects.instance [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'migration_context' on Instance uuid ff518f36-defb-4f41-aaf0-9a1e5238a20d {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.objects.base [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Object Instance<ff518f36-defb-4f41-aaf0-9a1e5238a20d> lazy-loaded attributes: info_cache,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Instance destroyed successfully.
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.objects.instance [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lazy-loading 'resources' on Instance uuid 3b9a4670-501d-4798-b4f1-fef51995caf2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2083812466',display_name='tempest-AttachVolumeNegativeTest-server-2083812466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2083812466',id=35,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAsO2kgPyQ0QX2XclHS0rZD89xrtPe+3Bd6mSyphcXT+SpEN2VnbAloGXXx04Cs6+BtpXXGM0daBk9Gi+56Wl0Fa4hzpLFGwWDUQpb0lUo5HL+gdQKT+pefYcKooGrB4A==',key_name='tempest-keypair-644287845',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e07b30415774466817048f8090437ee',ramdisk_id='',reservation_id='r-9av086v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-294403091',owner_user_name='tempest-AttachVolumeNegativeTest-294403091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7604ae732734f05aaa7aeebf8ef5e1a',uuid=3b9a4670-501d-4798-b4f1-fef51995caf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converting VIF {"id": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "address": "fa:16:3e:23:81:26", "network": {"id": "c277c612-33c9-42ac-9a33-2883872d43b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1977266970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e07b30415774466817048f8090437ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3aaaba-6b", "ovs_interfaceid": "8c3aaaba-6b7d-4ae2-abff-8fae61e21732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG os_vif [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c3aaaba-6b, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73386655-b79f-421f-b2ad-261272829371) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:28 user nova-compute[74075]: INFO os_vif [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:81:26,bridge_name='br-int',has_traffic_filtering=True,id=8c3aaaba-6b7d-4ae2-abff-8fae61e21732,network=Network(c277c612-33c9-42ac-9a33-2883872d43b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3aaaba-6b')
Oct 26 09:47:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Deleting instance files /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2_del
Oct 26 09:47:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Deletion of /opt/stack/data/nova/instances/3b9a4670-501d-4798-b4f1-fef51995caf2_del complete
Oct 26 09:47:28 user nova-compute[74075]: INFO nova.compute.manager [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Took 1.09 seconds to destroy the instance on the hypervisor.
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating instance_info_cache with network_info: [{"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Releasing lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Instance network_info: |[{"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] Acquired lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Refreshing network info cache for port 24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Start _get_guest_xml network_info=[{"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:47:28 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:47:28 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-759500269',display_name='tempest-TestServerVolumeAttachmentScenario-server-759500269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-759500269',id=37,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnEMUQKBeVvbqIvuvZ1ZXuirq2UEwy/GmElg7RwCtzvt25HKvzzRSOl5croNZHbSM6a2Md0WhVv8+x1a0FJPWxPIelfcqcL7MoSLSY0ikyT63w5cenSdNgvHND+ke2iSA==',key_name='tempest-keypair-2072427545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28294d57b6c04f64a6b8e97f11e95389',ramdisk_id='',reservation_id='r-n5bxvz9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1760918044',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1760918044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d292ea326cf940beb182512cf6824950',uuid=85425c37-c0b8-45c3-ae72-0480730a1979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Converting VIF {"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'pci_devices' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.618s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:47:28 user nova-compute[74075]:   <uuid>85425c37-c0b8-45c3-ae72-0480730a1979</uuid>
Oct 26 09:47:28 user nova-compute[74075]:   <name>instance-00000025</name>
Oct 26 09:47:28 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:47:28 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:47:28 user nova-compute[74075]:   <metadata>
Oct 26 09:47:28 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:47:28 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:47:28 user nova-compute[74075]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-759500269</nova:name>
Oct 26 09:47:28 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:47:28</nova:creationTime>
Oct 26 09:47:28 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:47:28 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:47:28 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:47:28 user nova-compute[74075]:       <nova:owner>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:user uuid="d292ea326cf940beb182512cf6824950">tempest-TestServerVolumeAttachmentScenario-1760918044-project-member</nova:user>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:project uuid="28294d57b6c04f64a6b8e97f11e95389">tempest-TestServerVolumeAttachmentScenario-1760918044</nova:project>
Oct 26 09:47:28 user nova-compute[74075]:       </nova:owner>
Oct 26 09:47:28 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:47:28 user nova-compute[74075]:       <nova:ports>
Oct 26 09:47:28 user nova-compute[74075]:         <nova:port uuid="24efb4af-953d-40b6-abdd-a7c2c381941a">
Oct 26 09:47:28 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:47:28 user nova-compute[74075]:         </nova:port>
Oct 26 09:47:28 user nova-compute[74075]:       </nova:ports>
Oct 26 09:47:28 user nova-compute[74075]:     </nova:instance>
Oct 26 09:47:28 user nova-compute[74075]:   </metadata>
Oct 26 09:47:28 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:47:28 user nova-compute[74075]:     <system>
Oct 26 09:47:28 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:47:28 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:47:28 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:47:28 user nova-compute[74075]:       <entry name="serial">85425c37-c0b8-45c3-ae72-0480730a1979</entry>
Oct 26 09:47:28 user nova-compute[74075]:       <entry name="uuid">85425c37-c0b8-45c3-ae72-0480730a1979</entry>
Oct 26 09:47:28 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:47:28 user nova-compute[74075]:     </system>
Oct 26 09:47:28 user nova-compute[74075]:   </sysinfo>
Oct 26 09:47:28 user nova-compute[74075]:   <os>
Oct 26 09:47:28 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:47:28 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:47:28 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:47:28 user nova-compute[74075]:   </os>
Oct 26 09:47:28 user nova-compute[74075]:   <features>
Oct 26 09:47:28 user nova-compute[74075]:     <acpi/>
Oct 26 09:47:28 user nova-compute[74075]:     <apic/>
Oct 26 09:47:28 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:47:28 user nova-compute[74075]:   </features>
Oct 26 09:47:28 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:47:28 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:47:28 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:47:28 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:47:28 user nova-compute[74075]:   </clock>
Oct 26 09:47:28 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:47:28 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:47:28 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:47:28 user nova-compute[74075]:   </cpu>
Oct 26 09:47:28 user nova-compute[74075]:   <devices>
Oct 26 09:47:28 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:47:28 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:47:28 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk"/>
Oct 26 09:47:28 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:47:28 user nova-compute[74075]:     </disk>
Oct 26 09:47:28 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:47:28 user nova-compute[74075]:       <mac address="fa:16:3e:7c:29:58"/>
Oct 26 09:47:28 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:47:28 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:47:28 user nova-compute[74075]:       <target dev="tap24efb4af-95"/>
Oct 26 09:47:28 user nova-compute[74075]:     </interface>
Oct 26 09:47:28 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:47:28 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/console.log" append="off"/>
Oct 26 09:47:28 user nova-compute[74075]:     </serial>
Oct 26 09:47:28 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:47:28 user nova-compute[74075]:     <video>
Oct 26 09:47:28 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:47:28 user nova-compute[74075]:     </video>
Oct 26 09:47:28 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:47:28 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:47:28 user nova-compute[74075]:     </rng>
Oct 26 09:47:28 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:47:28 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:47:28 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:47:28 user nova-compute[74075]:     </memballoon>
Oct 26 09:47:28 user nova-compute[74075]:   </devices>
Oct 26 09:47:28 user nova-compute[74075]: </domain>
Oct 26 09:47:28 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-759500269',display_name='tempest-TestServerVolumeAttachmentScenario-server-759500269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-759500269',id=37,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnEMUQKBeVvbqIvuvZ1ZXuirq2UEwy/GmElg7RwCtzvt25HKvzzRSOl5croNZHbSM6a2Md0WhVv8+x1a0FJPWxPIelfcqcL7MoSLSY0ikyT63w5cenSdNgvHND+ke2iSA==',key_name='tempest-keypair-2072427545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28294d57b6c04f64a6b8e97f11e95389',ramdisk_id='',reservation_id='r-n5bxvz9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1760918044',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1760918044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d292ea326cf940beb182512cf6824950',uuid=85425c37-c0b8-45c3-ae72-0480730a1979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Converting VIF {"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG os_vif [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72ddfece-07f0-52c1-8062-dd0a9f4e7b07', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24efb4af-95, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24efb4af-95, col_values=(('qos', UUID('aef9d100-d80a-4988-ace7-d28ffda80e94')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24efb4af-95, col_values=(('external_ids', {'iface-id': '24efb4af-953d-40b6-abdd-a7c2c381941a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:29:58', 'vm-uuid': '85425c37-c0b8-45c3-ae72-0480730a1979'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:28 user nova-compute[74075]: INFO os_vif [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95')
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:47:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No VIF found with MAC fa:16:3e:7c:29:58, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:47:29 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Deleted allocation for migration 36337e95-f13e-4c5d-8f80-9df0b1c76b21
Oct 26 09:47:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-43d14ca7-99a8-44d2-9a0d-7bf789f56a50 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.230s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updated VIF entry in instance network info cache for port 24efb4af-953d-40b6-abdd-a7c2c381941a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating instance_info_cache with network_info: [{"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5d136f5d-f09b-433f-99f1-5e1fab1a50cb req-f7749fd4-f7a4-4329-a219-dbc027c154ee service nova] Releasing lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:29 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Took 0.93 seconds to deallocate network for instance.
Oct 26 09:47:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-f5264364-2d3e-40b4-a5b3-9f310ea54bcd req-dd176cb6-204e-440f-ae64-d70d319e9116 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-vif-deleted-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:47:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:30 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Deleted allocations for instance 3b9a4670-501d-4798-b4f1-fef51995caf2
Oct 26 09:47:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-1d32342a-969e-4543-8f03-4365581b5420 req-29c4f650-b9fd-448c-9590-4ab3a6ae89d8 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received event network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1d32342a-969e-4543-8f03-4365581b5420 req-29c4f650-b9fd-448c-9590-4ab3a6ae89d8 service nova] Acquiring lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1d32342a-969e-4543-8f03-4365581b5420 req-29c4f650-b9fd-448c-9590-4ab3a6ae89d8 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1d32342a-969e-4543-8f03-4365581b5420 req-29c4f650-b9fd-448c-9590-4ab3a6ae89d8 service nova] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-1d32342a-969e-4543-8f03-4365581b5420 req-29c4f650-b9fd-448c-9590-4ab3a6ae89d8 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] No waiting events found dispatching network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:30 user nova-compute[74075]: WARNING nova.compute.manager [req-1d32342a-969e-4543-8f03-4365581b5420 req-29c4f650-b9fd-448c-9590-4ab3a6ae89d8 service nova] [instance: 3b9a4670-501d-4798-b4f1-fef51995caf2] Received unexpected event network-vif-plugged-8c3aaaba-6b7d-4ae2-abff-8fae61e21732 for instance with vm_state deleted and task_state None.
Oct 26 09:47:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-da16e682-dc70-4bfd-811e-13d0d1785bab tempest-AttachVolumeNegativeTest-294403091 tempest-AttachVolumeNegativeTest-294403091-project-member] Lock "3b9a4670-501d-4798-b4f1-fef51995caf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] No waiting events found dispatching network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:31 user nova-compute[74075]: WARNING nova.compute.manager [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received unexpected event network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a for instance with vm_state building and task_state spawning.
Oct 26 09:47:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] No waiting events found dispatching network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:31 user nova-compute[74075]: WARNING nova.compute.manager [req-9641aa0a-34c3-426d-ab70-6ad7f26e748b req-075a0425-a0ae-4664-9056-eb1941f1e966 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received unexpected event network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a for instance with vm_state building and task_state spawning.
Oct 26 09:47:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:47:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Instance spawned successfully.
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:33 user nova-compute[74075]: INFO nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Took 7.07 seconds to spawn the instance on the hypervisor.
Oct 26 09:47:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:47:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:47:33 user nova-compute[74075]: INFO nova.compute.manager [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Took 8.25 seconds to build instance.
Oct 26 09:47:33 user nova-compute[74075]: INFO nova.compute.manager [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] instance snapshotting
Oct 26 09:47:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8401f059-b227-48ef-8b92-b9615c148319 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.379s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Beginning live snapshot process
Oct 26 09:47:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.264s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json -f qcow2 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:33 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphi3zdmmc/6fd0704eeb76471aada7b877496ee465.delta 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphi3zdmmc/6fd0704eeb76471aada7b877496ee465.delta 1073741824" returned: 0 in 0.055s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 09:47:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:47:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] COPY block job progress, current cursor: 17301504 final cursor: 75563008 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:47:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74075) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 09:47:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 09:47:36 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:47:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphi3zdmmc/6fd0704eeb76471aada7b877496ee465.delta /opt/stack/data/nova/instances/snapshots/tmphi3zdmmc/6fd0704eeb76471aada7b877496ee465 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphi3zdmmc/6fd0704eeb76471aada7b877496ee465.delta /opt/stack/data/nova/instances/snapshots/tmphi3zdmmc/6fd0704eeb76471aada7b877496ee465" returned: 0 in 0.681s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:37 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Snapshot extracted, beginning image upload
Oct 26 09:47:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:40 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Snapshot image upload complete
Oct 26 09:47:40 user nova-compute[74075]: INFO nova.compute.manager [None req-49777654-508a-4932-8fc2-2b82eb179d99 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Took 6.84 seconds to snapshot the instance on the hypervisor.
Oct 26 09:47:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:47:42 user nova-compute[74075]: INFO nova.compute.claims [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Claim successful on node user
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:47:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.policy [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf9ff8178c904ceea3b85d797650a304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cb49aac77047538029297c23344641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:47:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:47:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:47:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:47:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Creating image(s)
Oct 26 09:47:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "/opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "/opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "496ec8886cd684a3a8df348036862fc142da2ec0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "496ec8886cd684a3a8df348036862fc142da2ec0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Successfully created port: 29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG nova.virt.images [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] 85bc8e5d-b5a1-4d67-b19a-362fa930b5fb was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.part /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.part /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.converted" returned: 0 in 0.667s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Successfully updated port: 29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquired lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-changed-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Refreshing instance network info cache due to event network-changed-29c7fb49-2ee1-430f-b75a-950875012b61. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] Acquiring lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "496ec8886cd684a3a8df348036862fc142da2ec0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.055s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "496ec8886cd684a3a8df348036862fc142da2ec0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "496ec8886cd684a3a8df348036862fc142da2ec0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updating instance_info_cache with network_info: [{"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 --force-share --output=json" returned: 0 in 0.290s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0,backing_fmt=raw /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Releasing lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Instance network_info: |[{"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] Acquired lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.neutron [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Refreshing network info cache for port 29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0,backing_fmt=raw /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "496ec8886cd684a3a8df348036862fc142da2ec0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Ensure instance console log exists: /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Start _get_guest_xml network_info=[{"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='342c8fb8bd227d07eb2e024e85bb57ce',container_format='bare',created_at=2023-10-26T09:47:33Z,direct_url=<?>,disk_format='qcow2',id=85bc8e5d-b5a1-4d67-b19a-362fa930b5fb,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2103315633',owner='53cb49aac77047538029297c23344641',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T09:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': '85bc8e5d-b5a1-4d67-b19a-362fa930b5fb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:47:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:47:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='342c8fb8bd227d07eb2e024e85bb57ce',container_format='bare',created_at=2023-10-26T09:47:33Z,direct_url=<?>,disk_format='qcow2',id=85bc8e5d-b5a1-4d67-b19a-362fa930b5fb,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2103315633',owner='53cb49aac77047538029297c23344641',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T09:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1196659873',display_name='tempest-TestStampPattern-server-1196659873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1196659873',id=38,image_ref='85bc8e5d-b5a1-4d67-b19a-362fa930b5fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUoA12fFzyxIidWvPzA82JwSs6uEZAWp7RKvuuCfDblrhjd6DrukV5OsNKW8Bc7RGvFWptS9TUXTjs7p+Xhq0qIjtUzg1YR7CMjVI5cXK132AArebr/4HHM8dfFtXG1w==',key_name='tempest-TestStampPattern-418773924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53cb49aac77047538029297c23344641',ramdisk_id='',reservation_id='r-b4189hue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b73b245a-454a-4082-87e1-2f759341a7a7',image_min_disk='1',image_min_ram='0',image_owner_id='53cb49aac77047538029297c23344641',image_owner_project_name='tempest-TestStampPattern-1997579810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1997579810-project-member',image_user_id='cf9ff8178c904ceea3b85d797650a304',network_allocated='True',owner_project_name='tempest-TestStampPattern-1997579810',owner_user_name='tempest-TestStampPattern-1997579810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:47:43Z,user_data=None,user_id='cf9ff8178c904ceea3b85d797650a304',uuid=f9115af6-8ae3-4e97-9eba-94dab733147f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converting VIF {"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:47:45 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'pci_devices' on Instance uuid f9115af6-8ae3-4e97-9eba-94dab733147f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:47:46 user nova-compute[74075]:   <uuid>f9115af6-8ae3-4e97-9eba-94dab733147f</uuid>
Oct 26 09:47:46 user nova-compute[74075]:   <name>instance-00000026</name>
Oct 26 09:47:46 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:47:46 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:47:46 user nova-compute[74075]:   <metadata>
Oct 26 09:47:46 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:47:46 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:47:46 user nova-compute[74075]:       <nova:name>tempest-TestStampPattern-server-1196659873</nova:name>
Oct 26 09:47:46 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:47:45</nova:creationTime>
Oct 26 09:47:46 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:47:46 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:47:46 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:47:46 user nova-compute[74075]:       <nova:owner>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:user uuid="cf9ff8178c904ceea3b85d797650a304">tempest-TestStampPattern-1997579810-project-member</nova:user>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:project uuid="53cb49aac77047538029297c23344641">tempest-TestStampPattern-1997579810</nova:project>
Oct 26 09:47:46 user nova-compute[74075]:       </nova:owner>
Oct 26 09:47:46 user nova-compute[74075]:       <nova:root type="image" uuid="85bc8e5d-b5a1-4d67-b19a-362fa930b5fb"/>
Oct 26 09:47:46 user nova-compute[74075]:       <nova:ports>
Oct 26 09:47:46 user nova-compute[74075]:         <nova:port uuid="29c7fb49-2ee1-430f-b75a-950875012b61">
Oct 26 09:47:46 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 09:47:46 user nova-compute[74075]:         </nova:port>
Oct 26 09:47:46 user nova-compute[74075]:       </nova:ports>
Oct 26 09:47:46 user nova-compute[74075]:     </nova:instance>
Oct 26 09:47:46 user nova-compute[74075]:   </metadata>
Oct 26 09:47:46 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:47:46 user nova-compute[74075]:     <system>
Oct 26 09:47:46 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:47:46 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:47:46 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:47:46 user nova-compute[74075]:       <entry name="serial">f9115af6-8ae3-4e97-9eba-94dab733147f</entry>
Oct 26 09:47:46 user nova-compute[74075]:       <entry name="uuid">f9115af6-8ae3-4e97-9eba-94dab733147f</entry>
Oct 26 09:47:46 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:47:46 user nova-compute[74075]:     </system>
Oct 26 09:47:46 user nova-compute[74075]:   </sysinfo>
Oct 26 09:47:46 user nova-compute[74075]:   <os>
Oct 26 09:47:46 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:47:46 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:47:46 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:47:46 user nova-compute[74075]:   </os>
Oct 26 09:47:46 user nova-compute[74075]:   <features>
Oct 26 09:47:46 user nova-compute[74075]:     <acpi/>
Oct 26 09:47:46 user nova-compute[74075]:     <apic/>
Oct 26 09:47:46 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:47:46 user nova-compute[74075]:   </features>
Oct 26 09:47:46 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:47:46 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:47:46 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:47:46 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:47:46 user nova-compute[74075]:   </clock>
Oct 26 09:47:46 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:47:46 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:47:46 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:47:46 user nova-compute[74075]:   </cpu>
Oct 26 09:47:46 user nova-compute[74075]:   <devices>
Oct 26 09:47:46 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:47:46 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:47:46 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk"/>
Oct 26 09:47:46 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:47:46 user nova-compute[74075]:     </disk>
Oct 26 09:47:46 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:47:46 user nova-compute[74075]:       <mac address="fa:16:3e:34:ae:a8"/>
Oct 26 09:47:46 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:47:46 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:47:46 user nova-compute[74075]:       <target dev="tap29c7fb49-2e"/>
Oct 26 09:47:46 user nova-compute[74075]:     </interface>
Oct 26 09:47:46 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:47:46 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/console.log" append="off"/>
Oct 26 09:47:46 user nova-compute[74075]:     </serial>
Oct 26 09:47:46 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:47:46 user nova-compute[74075]:     <video>
Oct 26 09:47:46 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:47:46 user nova-compute[74075]:     </video>
Oct 26 09:47:46 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:47:46 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:47:46 user nova-compute[74075]:     </rng>
Oct 26 09:47:46 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:47:46 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:47:46 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:47:46 user nova-compute[74075]:     </memballoon>
Oct 26 09:47:46 user nova-compute[74075]:   </devices>
Oct 26 09:47:46 user nova-compute[74075]: </domain>
Oct 26 09:47:46 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1196659873',display_name='tempest-TestStampPattern-server-1196659873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1196659873',id=38,image_ref='85bc8e5d-b5a1-4d67-b19a-362fa930b5fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUoA12fFzyxIidWvPzA82JwSs6uEZAWp7RKvuuCfDblrhjd6DrukV5OsNKW8Bc7RGvFWptS9TUXTjs7p+Xhq0qIjtUzg1YR7CMjVI5cXK132AArebr/4HHM8dfFtXG1w==',key_name='tempest-TestStampPattern-418773924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53cb49aac77047538029297c23344641',ramdisk_id='',reservation_id='r-b4189hue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b73b245a-454a-4082-87e1-2f759341a7a7',image_min_disk='1',image_min_ram='0',image_owner_id='53cb49aac77047538029297c23344641',image_owner_project_name='tempest-TestStampPattern-1997579810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1997579810-project-member',image_user_id='cf9ff8178c904ceea3b85d797650a304',network_allocated='True',owner_project_name='tempest-TestStampPattern-1997579810',owner_user_name='tempest-TestStampPattern-1997579810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:47:43Z,user_data=None,user_id='cf9ff8178c904ceea3b85d797650a304',uuid=f9115af6-8ae3-4e97-9eba-94dab733147f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converting VIF {"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG os_vif [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '566501f9-2f6b-5465-87c5-6e38f410d927', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29c7fb49-2e, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29c7fb49-2e, col_values=(('qos', UUID('e5d0b846-21a3-4d30-aa2b-847c0f80c3f8')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29c7fb49-2e, col_values=(('external_ids', {'iface-id': '29c7fb49-2ee1-430f-b75a-950875012b61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:ae:a8', 'vm-uuid': 'f9115af6-8ae3-4e97-9eba-94dab733147f'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:46 user nova-compute[74075]: INFO os_vif [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e')
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No VIF found with MAC fa:16:3e:34:ae:a8, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updated VIF entry in instance network info cache for port 29c7fb49-2ee1-430f-b75a-950875012b61. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updating instance_info_cache with network_info: [{"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f3d4f21e-9ac8-454d-9bb6-805fb9a9d56b req-75c8758e-97c4-4d65-bffd-17e3b96baf96 service nova] Releasing lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-4391b9bb-2678-450e-8381-26cf97108e94 req-ac79879f-0e37-4935-8411-9248f9142629 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4391b9bb-2678-450e-8381-26cf97108e94 req-ac79879f-0e37-4935-8411-9248f9142629 service nova] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4391b9bb-2678-450e-8381-26cf97108e94 req-ac79879f-0e37-4935-8411-9248f9142629 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4391b9bb-2678-450e-8381-26cf97108e94 req-ac79879f-0e37-4935-8411-9248f9142629 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-4391b9bb-2678-450e-8381-26cf97108e94 req-ac79879f-0e37-4935-8411-9248f9142629 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] No waiting events found dispatching network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:47 user nova-compute[74075]: WARNING nova.compute.manager [req-4391b9bb-2678-450e-8381-26cf97108e94 req-ac79879f-0e37-4935-8411-9248f9142629 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received unexpected event network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 for instance with vm_state building and task_state spawning.
Oct 26 09:47:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ee6d629-fd0a-484c-94d9-c72658a307f0 req-48bf72d1-06a0-4123-8359-e102783f6300 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ee6d629-fd0a-484c-94d9-c72658a307f0 req-48bf72d1-06a0-4123-8359-e102783f6300 service nova] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ee6d629-fd0a-484c-94d9-c72658a307f0 req-48bf72d1-06a0-4123-8359-e102783f6300 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8ee6d629-fd0a-484c-94d9-c72658a307f0 req-48bf72d1-06a0-4123-8359-e102783f6300 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-8ee6d629-fd0a-484c-94d9-c72658a307f0 req-48bf72d1-06a0-4123-8359-e102783f6300 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] No waiting events found dispatching network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:49 user nova-compute[74075]: WARNING nova.compute.manager [req-8ee6d629-fd0a-484c-94d9-c72658a307f0 req-48bf72d1-06a0-4123-8359-e102783f6300 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received unexpected event network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 for instance with vm_state building and task_state spawning.
Oct 26 09:47:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:47:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:47:50 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Instance spawned successfully.
Oct 26 09:47:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:47:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:47:50 user nova-compute[74075]: INFO nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Took 7.01 seconds to spawn the instance on the hypervisor.
Oct 26 09:47:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:47:50 user nova-compute[74075]: INFO nova.compute.manager [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Took 8.17 seconds to build instance.
Oct 26 09:47:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b910f9c5-9ea6-43e4-b302-28ced3c3750e tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.281s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:57 user nova-compute[74075]: INFO nova.compute.manager [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Terminating instance
Oct 26 09:47:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-dbe1c0a7-5baa-44ae-8cd7-260a356110af req-0afe4518-a228-475e-960e-1875b7719a4f service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dbe1c0a7-5baa-44ae-8cd7-260a356110af req-0afe4518-a228-475e-960e-1875b7719a4f service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dbe1c0a7-5baa-44ae-8cd7-260a356110af req-0afe4518-a228-475e-960e-1875b7719a4f service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dbe1c0a7-5baa-44ae-8cd7-260a356110af req-0afe4518-a228-475e-960e-1875b7719a4f service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-dbe1c0a7-5baa-44ae-8cd7-260a356110af req-0afe4518-a228-475e-960e-1875b7719a4f service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-dbe1c0a7-5baa-44ae-8cd7-260a356110af req-0afe4518-a228-475e-960e-1875b7719a4f service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-unplugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Instance destroyed successfully.
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'resources' on Instance uuid 9266332d-6d4a-4810-ab56-ce5019f74f04 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353160260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353160260',id=31,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:44:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-a5zdyaqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:46:12Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=9266332d-6d4a-4810-ab56-ce5019f74f04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "address": "fa:16:3e:df:88:76", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5592cbe-13", "ovs_interfaceid": "e5592cbe-13c0-48ad-8f2b-16ff8e70e46e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_vif [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5592cbe-13, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11275775-a7d8-4c1a-8917-0c5871690ed9) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:47:58 user nova-compute[74075]: INFO os_vif [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:76,bridge_name='br-int',has_traffic_filtering=True,id=e5592cbe-13c0-48ad-8f2b-16ff8e70e46e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5592cbe-13')
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaLeXRYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:47:58 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45821fb-bdef-4ad7-bc84-49a286e5fd72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:47:58 user nova-compute[74075]: No targets found.
Oct 26 09:47:58 user nova-compute[74075]: iSNS:
Oct 26 09:47:58 user nova-compute[74075]: No targets found.
Oct 26 09:47:58 user nova-compute[74075]: STATIC:
Oct 26 09:47:58 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a
Oct 26 09:47:58 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:47:58 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:47:58 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e
Oct 26 09:47:58 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:47:58 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:47:58 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:47:58 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:47:58 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:47:58 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:47:58 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:47:58 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:47:58 user nova-compute[74075]: FIRMWARE:
Oct 26 09:47:58 user nova-compute[74075]: No targets found.
Oct 26 09:47:58 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:47:58 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:47:58 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[934e3172-28bc-4e63-a496-ca95d4d56bbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95cce52-326d-4743-a2c7-e38c4b4f840e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:47:58 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:47:58 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:47:58 user nova-compute[74075]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)
Oct 26 09:47:58 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:47:58 user nova-compute[74075]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e (non-flash)
Oct 26 09:47:58 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:47:58 user nova-compute[74075]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)
Oct 26 09:47:58 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f465c3a79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c62af06-607d-4e1f-ab2d-94088c37e1eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6431ec4-faf4-4597-b365-8c54e5915140]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8307a6c-e665-4be9-a791-cf4ad40b405e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2295eea-854b-4f65-8cef-e0edfb877b47]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23962623934333737', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b14e1bf4', '/dev/disk/by-id/scsi-1SCST_BIOb14e1bf4-9bb943779877ab76') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 09:47:58 user nova-compute[74075]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23962623934333737
Oct 26 09:47:58 user nova-compute[74075]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b14e1bf4
Oct 26 09:47:58 user nova-compute[74075]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb14e1bf4-9bb943779877ab76
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2e4d8-aa97-4283-a4c8-5851c98d3f85]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b6b10d-a8a9-417b-8ccc-ee5dfa32dd42]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf86643-c1e8-4805-b9af-51f7c00326fe]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260]
Oct 26 09:47:58 user nova-compute[74075]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e, portal: 172.16.0.220,3260] successful.
Oct 26 09:47:58 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55966697-c3de-4a15-9dea-4cc256ed075e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c0559-d85b-493d-9dc5-d915a33fb2c0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== disconnect_volume: return (392ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:47:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Deleting instance files /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04_del
Oct 26 09:47:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Deletion of /opt/stack/data/nova/instances/9266332d-6d4a-4810-ab56-ce5019f74f04_del complete
Oct 26 09:47:58 user nova-compute[74075]: INFO nova.compute.manager [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Took 1.47 seconds to destroy the instance on the hypervisor.
Oct 26 09:47:58 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:47:58 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:47:59 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:47:59 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Took 0.50 seconds to deallocate network for instance.
Oct 26 09:47:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] Acquiring lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:47:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:47:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:47:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] No waiting events found dispatching network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:47:59 user nova-compute[74075]: WARNING nova.compute.manager [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received unexpected event network-vif-plugged-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e for instance with vm_state active and task_state deleting.
Oct 26 09:47:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-b7fa178c-4727-4fe6-b0dc-71efc5c114f6 req-e1818227-d7b1-491e-b5ea-9a1f393322d5 service nova] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Received event network-vif-deleted-e5592cbe-13c0-48ad-8f2b-16ff8e70e46e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:47:59 user nova-compute[74075]: INFO nova.compute.manager [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 9266332d-6d4a-4810-ab56-ce5019f74f04] Took 0.89 seconds to detach 1 volumes for instance.
Oct 26 09:48:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:00 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:48:00 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:48:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:00 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Deleted allocations for instance 9266332d-6d4a-4810-ab56-ce5019f74f04
Oct 26 09:48:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a0d616a-c352-4dea-81ec-e551ca2f0d96 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "9266332d-6d4a-4810-ab56-ce5019f74f04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:02 user nova-compute[74075]: INFO nova.compute.manager [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Detaching volume 25cce109-d037-449e-854b-fb1d85c7a80a
Oct 26 09:48:02 user nova-compute[74075]: INFO nova.virt.block_device [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attempting to driver detach volume 25cce109-d037-449e-854b-fb1d85c7a80a from mountpoint /dev/vdb
Oct 26 09:48:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Attempting to detach device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:48:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:48:02 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:48:02 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:48:02 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:48:02 user nova-compute[74075]:   <serial>25cce109-d037-449e-854b-fb1d85c7a80a</serial>
Oct 26 09:48:02 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:48:02 user nova-compute[74075]: </disk>
Oct 26 09:48:02 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:48:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config.
Oct 26 09:48:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:48:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:48:02 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:48:02 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:48:02 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:48:02 user nova-compute[74075]:   <serial>25cce109-d037-449e-854b-fb1d85c7a80a</serial>
Oct 26 09:48:02 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:48:02 user nova-compute[74075]: </disk>
Oct 26 09:48:02 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:48:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:48:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:48:04 user nova-compute[74075]: INFO nova.compute.claims [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Claim successful on node user
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:48:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.policy [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b426e1ce287140808e69375cb864c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6280808c74bc29546ad4380d18c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:48:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Creating image(s)
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "/opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "/opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.214s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk 1073741824" returned: 0 in 0.053s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Successfully created port: 9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Cannot resize image /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Successfully updated port: 9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquired lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-changed-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Refreshing instance network info cache due to event network-changed-9c5c72e8-e807-47ee-8b46-c35b4185965d. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] Acquiring lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:48:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updating instance_info_cache with network_info: [{"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Releasing lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Instance network_info: |[{"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] Acquired lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.neutron [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Refreshing network info cache for port 9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Start _get_guest_xml network_info=[{"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:48:06 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:48:06 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1734526257',display_name='tempest-VolumesSnapshotTestJSON-instance-1734526257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1734526257',id=39,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyiefyBphypBJ9rmDSmjzOXUQl5yt2P7FE1a+4XKSO4K9ewhcIpR+Zq1DDtjFfKS/OejBlP/8lwuKmOIZ3DUHNKx3UZa6QpMSj2VC6J/oN58K5kN5t7hbnLFkbSJPTBrQ==',key_name='tempest-keypair-507924393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02c6280808c74bc29546ad4380d18c00',ramdisk_id='',reservation_id='r-k05705dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1278929434',owner_user_name='tempest-VolumesSnapshotTestJSON-1278929434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b426e1ce287140808e69375cb864c8c1',uuid=a8f6e50a-7930-41b5-b01d-9364a8061593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converting VIF {"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'pci_devices' on Instance uuid a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:48:06 user nova-compute[74075]:   <uuid>a8f6e50a-7930-41b5-b01d-9364a8061593</uuid>
Oct 26 09:48:06 user nova-compute[74075]:   <name>instance-00000027</name>
Oct 26 09:48:06 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:48:06 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:48:06 user nova-compute[74075]:   <metadata>
Oct 26 09:48:06 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:48:06 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:48:06 user nova-compute[74075]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1734526257</nova:name>
Oct 26 09:48:06 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:48:06</nova:creationTime>
Oct 26 09:48:06 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:48:06 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:48:06 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:48:06 user nova-compute[74075]:       <nova:owner>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:user uuid="b426e1ce287140808e69375cb864c8c1">tempest-VolumesSnapshotTestJSON-1278929434-project-member</nova:user>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:project uuid="02c6280808c74bc29546ad4380d18c00">tempest-VolumesSnapshotTestJSON-1278929434</nova:project>
Oct 26 09:48:06 user nova-compute[74075]:       </nova:owner>
Oct 26 09:48:06 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:48:06 user nova-compute[74075]:       <nova:ports>
Oct 26 09:48:06 user nova-compute[74075]:         <nova:port uuid="9c5c72e8-e807-47ee-8b46-c35b4185965d">
Oct 26 09:48:06 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 09:48:06 user nova-compute[74075]:         </nova:port>
Oct 26 09:48:06 user nova-compute[74075]:       </nova:ports>
Oct 26 09:48:06 user nova-compute[74075]:     </nova:instance>
Oct 26 09:48:06 user nova-compute[74075]:   </metadata>
Oct 26 09:48:06 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:48:06 user nova-compute[74075]:     <system>
Oct 26 09:48:06 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:48:06 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:48:06 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:48:06 user nova-compute[74075]:       <entry name="serial">a8f6e50a-7930-41b5-b01d-9364a8061593</entry>
Oct 26 09:48:06 user nova-compute[74075]:       <entry name="uuid">a8f6e50a-7930-41b5-b01d-9364a8061593</entry>
Oct 26 09:48:06 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:48:06 user nova-compute[74075]:     </system>
Oct 26 09:48:06 user nova-compute[74075]:   </sysinfo>
Oct 26 09:48:06 user nova-compute[74075]:   <os>
Oct 26 09:48:06 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:48:06 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:48:06 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:48:06 user nova-compute[74075]:   </os>
Oct 26 09:48:06 user nova-compute[74075]:   <features>
Oct 26 09:48:06 user nova-compute[74075]:     <acpi/>
Oct 26 09:48:06 user nova-compute[74075]:     <apic/>
Oct 26 09:48:06 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:48:06 user nova-compute[74075]:   </features>
Oct 26 09:48:06 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:48:06 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:48:06 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:48:06 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:48:06 user nova-compute[74075]:   </clock>
Oct 26 09:48:06 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:48:06 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:48:06 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:48:06 user nova-compute[74075]:   </cpu>
Oct 26 09:48:06 user nova-compute[74075]:   <devices>
Oct 26 09:48:06 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:48:06 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:48:06 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk"/>
Oct 26 09:48:06 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:48:06 user nova-compute[74075]:     </disk>
Oct 26 09:48:06 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:48:06 user nova-compute[74075]:       <mac address="fa:16:3e:96:4e:61"/>
Oct 26 09:48:06 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:48:06 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:48:06 user nova-compute[74075]:       <target dev="tap9c5c72e8-e8"/>
Oct 26 09:48:06 user nova-compute[74075]:     </interface>
Oct 26 09:48:06 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:48:06 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/console.log" append="off"/>
Oct 26 09:48:06 user nova-compute[74075]:     </serial>
Oct 26 09:48:06 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:48:06 user nova-compute[74075]:     <video>
Oct 26 09:48:06 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:48:06 user nova-compute[74075]:     </video>
Oct 26 09:48:06 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:48:06 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:48:06 user nova-compute[74075]:     </rng>
Oct 26 09:48:06 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:48:06 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:48:06 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:48:06 user nova-compute[74075]:     </memballoon>
Oct 26 09:48:06 user nova-compute[74075]:   </devices>
Oct 26 09:48:06 user nova-compute[74075]: </domain>
Oct 26 09:48:06 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1734526257',display_name='tempest-VolumesSnapshotTestJSON-instance-1734526257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1734526257',id=39,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyiefyBphypBJ9rmDSmjzOXUQl5yt2P7FE1a+4XKSO4K9ewhcIpR+Zq1DDtjFfKS/OejBlP/8lwuKmOIZ3DUHNKx3UZa6QpMSj2VC6J/oN58K5kN5t7hbnLFkbSJPTBrQ==',key_name='tempest-keypair-507924393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02c6280808c74bc29546ad4380d18c00',ramdisk_id='',reservation_id='r-k05705dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1278929434',owner_user_name='tempest-VolumesSnapshotTestJSON-1278929434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b426e1ce287140808e69375cb864c8c1',uuid=a8f6e50a-7930-41b5-b01d-9364a8061593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converting VIF {"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG os_vif [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34ddcc53-4e3a-5ccc-9382-cef621524de9', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c5c72e8-e8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c5c72e8-e8, col_values=(('qos', UUID('06b191e9-9456-4976-9b1a-e13354e3ccbd')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c5c72e8-e8, col_values=(('external_ids', {'iface-id': '9c5c72e8-e807-47ee-8b46-c35b4185965d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4e:61', 'vm-uuid': 'a8f6e50a-7930-41b5-b01d-9364a8061593'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:06 user nova-compute[74075]: INFO os_vif [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8')
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No VIF found with MAC fa:16:3e:96:4e:61, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.neutron [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updated VIF entry in instance network info cache for port 9c5c72e8-e807-47ee-8b46-c35b4185965d. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG nova.network.neutron [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updating instance_info_cache with network_info: [{"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:48:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-28977864-f8e8-4998-a5c3-c131d01fa02e req-4cd801c8-de82-48b1-a04e-91ffee68349f service nova] Releasing lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-dc0b8e83-dadb-45f0-bcf0-536003a7e9a6 req-ace2ca92-3da3-466a-80e4-7e51dbb00a34 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dc0b8e83-dadb-45f0-bcf0-536003a7e9a6 req-ace2ca92-3da3-466a-80e4-7e51dbb00a34 service nova] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dc0b8e83-dadb-45f0-bcf0-536003a7e9a6 req-ace2ca92-3da3-466a-80e4-7e51dbb00a34 service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dc0b8e83-dadb-45f0-bcf0-536003a7e9a6 req-ace2ca92-3da3-466a-80e4-7e51dbb00a34 service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-dc0b8e83-dadb-45f0-bcf0-536003a7e9a6 req-ace2ca92-3da3-466a-80e4-7e51dbb00a34 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] No waiting events found dispatching network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:48:08 user nova-compute[74075]: WARNING nova.compute.manager [req-dc0b8e83-dadb-45f0-bcf0-536003a7e9a6 req-ace2ca92-3da3-466a-80e4-7e51dbb00a34 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received unexpected event network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d for instance with vm_state building and task_state spawning.
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:48:10 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Instance spawned successfully.
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-072a685d-626d-495f-a871-bbf308106c23 req-9ac1d1e6-ae54-4a32-a85a-e9241780a674 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-072a685d-626d-495f-a871-bbf308106c23 req-9ac1d1e6-ae54-4a32-a85a-e9241780a674 service nova] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-072a685d-626d-495f-a871-bbf308106c23 req-9ac1d1e6-ae54-4a32-a85a-e9241780a674 service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-072a685d-626d-495f-a871-bbf308106c23 req-9ac1d1e6-ae54-4a32-a85a-e9241780a674 service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-072a685d-626d-495f-a871-bbf308106c23 req-9ac1d1e6-ae54-4a32-a85a-e9241780a674 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] No waiting events found dispatching network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:48:10 user nova-compute[74075]: WARNING nova.compute.manager [req-072a685d-626d-495f-a871-bbf308106c23 req-9ac1d1e6-ae54-4a32-a85a-e9241780a674 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received unexpected event network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d for instance with vm_state building and task_state spawning.
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:10 user nova-compute[74075]: INFO nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:48:10 user nova-compute[74075]: INFO nova.compute.manager [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Took 6.26 seconds to build instance.
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2080c11a-d002-4093-95f2-9d9aa48765df tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:48:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=24.989105224609375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 668b12c1-9874-472a-88ca-f6671d6a4ba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 85425c37-c0b8-45c3-ae72-0480730a1979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f9115af6-8ae3-4e97-9eba-94dab733147f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a8f6e50a-7930-41b5-b01d-9364a8061593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:48:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:48:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:22 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 is timed out.
Oct 26 09:48:22 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config.
Oct 26 09:48:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAWpCVjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:48:22 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3727ac17-332e-43a6-8d19-612b38df183a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:48:22 user nova-compute[74075]: No targets found.
Oct 26 09:48:22 user nova-compute[74075]: iSNS:
Oct 26 09:48:22 user nova-compute[74075]: No targets found.
Oct 26 09:48:22 user nova-compute[74075]: STATIC:
Oct 26 09:48:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a
Oct 26 09:48:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:48:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:48:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:48:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:48:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:48:22 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:48:22 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:48:22 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:48:22 user nova-compute[74075]: FIRMWARE:
Oct 26 09:48:22 user nova-compute[74075]: No targets found.
Oct 26 09:48:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:48:22 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:48:22 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[530bdddb-de85-43ef-b033-724f8dfea4e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc7ae18-afa9-4be8-a3cf-ece4b55b04d5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:48:22 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:48:22 user nova-compute[74075]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)
Oct 26 09:48:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:48:22 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:48:22 user nova-compute[74075]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a (non-flash)
Oct 26 09:48:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a'): ({'sde'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Removing single pathed devices sde {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ad918-e4a0-45f8-a8e1-854953e1202c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8571fbc8-5314-45d1-b4e8-9e18fafdf4ba]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Flushing IO for device /dev/sde {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde9c19c-5945-49e7-b263-56b81db0f6e8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d9ed7-e025-4bfd-87b8-083daf8476fe]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a949d7a2-04df-450c-9b34-1772efe6386a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb0f0e-5ebc-49ac-94e7-3d339f81163f]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260]
Oct 26 09:48:22 user nova-compute[74075]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a, portal: 172.16.0.220,3260] successful.
Oct 26 09:48:22 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25cce109-d037-449e-854b-fb1d85c7a80a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba1437b-6a6e-4226-b1ca-867d6d5f9684]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== disconnect_volume: return (325ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:48:22 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:48:23 user nova-compute[74075]: DEBUG nova.objects.instance [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:48:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfd06827-dcea-437c-b31a-449c75710543 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.900s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:48 user nova-compute[74075]: INFO nova.compute.manager [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Terminating instance
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-78516327-9f80-4d2a-a424-008f7d912538 req-8145689d-71a5-4e56-a538-6776d82e3d57 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-vif-unplugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-78516327-9f80-4d2a-a424-008f7d912538 req-8145689d-71a5-4e56-a538-6776d82e3d57 service nova] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-78516327-9f80-4d2a-a424-008f7d912538 req-8145689d-71a5-4e56-a538-6776d82e3d57 service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-78516327-9f80-4d2a-a424-008f7d912538 req-8145689d-71a5-4e56-a538-6776d82e3d57 service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-78516327-9f80-4d2a-a424-008f7d912538 req-8145689d-71a5-4e56-a538-6776d82e3d57 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] No waiting events found dispatching network-vif-unplugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-78516327-9f80-4d2a-a424-008f7d912538 req-8145689d-71a5-4e56-a538-6776d82e3d57 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-vif-unplugged-f496eb03-2f60-485a-b706-06afc29b9a78 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Instance destroyed successfully.
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.objects.instance [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'resources' on Instance uuid 668b12c1-9874-472a-88ca-f6671d6a4ba6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834608990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834608990',id=26,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-mrg5hmq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:41:21Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=668b12c1-9874-472a-88ca-f6671d6a4ba6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "f496eb03-2f60-485a-b706-06afc29b9a78", "address": "fa:16:3e:d2:3f:36", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496eb03-2f", "ovs_interfaceid": "f496eb03-2f60-485a-b706-06afc29b9a78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG os_vif [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf496eb03-2f, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b01e0cf-356f-4be0-8ef8-78f0233678eb) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:48:48 user nova-compute[74075]: INFO os_vif [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:3f:36,bridge_name='br-int',has_traffic_filtering=True,id=f496eb03-2f60-485a-b706-06afc29b9a78,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496eb03-2f')
Oct 26 09:48:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Deleting instance files /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6_del
Oct 26 09:48:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Deletion of /opt/stack/data/nova/instances/668b12c1-9874-472a-88ca-f6671d6a4ba6_del complete
Oct 26 09:48:48 user nova-compute[74075]: INFO nova.compute.manager [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 09:48:48 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:48:48 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:48:49 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:48:49 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Took 0.53 seconds to deallocate network for instance.
Oct 26 09:48:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-69a79e59-1438-4659-b2de-2f58605e586b req-9d193a27-2212-44de-999b-79d5f271aa28 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-vif-deleted-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:48:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:50 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Deleted allocations for instance 668b12c1-9874-472a-88ca-f6671d6a4ba6
Oct 26 09:48:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-20feb1a3-aade-4882-90f6-de3d9b6a9ea4 tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-30b81962-3d24-4c8e-9fab-affae65b8b8f req-4fdde981-5a93-46b2-9591-ca55850e0c66 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received event network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-30b81962-3d24-4c8e-9fab-affae65b8b8f req-4fdde981-5a93-46b2-9591-ca55850e0c66 service nova] Acquiring lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-30b81962-3d24-4c8e-9fab-affae65b8b8f req-4fdde981-5a93-46b2-9591-ca55850e0c66 service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-30b81962-3d24-4c8e-9fab-affae65b8b8f req-4fdde981-5a93-46b2-9591-ca55850e0c66 service nova] Lock "668b12c1-9874-472a-88ca-f6671d6a4ba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:50 user nova-compute[74075]: DEBUG nova.compute.manager [req-30b81962-3d24-4c8e-9fab-affae65b8b8f req-4fdde981-5a93-46b2-9591-ca55850e0c66 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] No waiting events found dispatching network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:48:50 user nova-compute[74075]: WARNING nova.compute.manager [req-30b81962-3d24-4c8e-9fab-affae65b8b8f req-4fdde981-5a93-46b2-9591-ca55850e0c66 service nova] [instance: 668b12c1-9874-472a-88ca-f6671d6a4ba6] Received unexpected event network-vif-plugged-f496eb03-2f60-485a-b706-06afc29b9a78 for instance with vm_state deleted and task_state None.
Oct 26 09:48:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:48:58 user nova-compute[74075]: INFO nova.compute.manager [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attaching volume 404fece8-f0f9-4706-87c7-ca270c171625 to /dev/vdb
Oct 26 09:48:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003c997-de15-41f3-88d0-7bf2f37f83ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a5db2-c9c9-4aec-9da2-ab942a564690]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76880d4-8bb7-405d-8d5e-a35590c713b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426d512-ead2-4c31-89f8-0c60e9d30039]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:48:58 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:48:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9303b-8f8c-450c-a7bb-9e8c6b97b890]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:48:58 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating existing volume attachment record: 9befcc08-d98b-434d-b5b4-18c76a605ff5 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:49:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [{"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-30d9df05-0182-4fb0-8a03-10d47bc7b0a2" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:49:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:49:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:49:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:49:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.07457733154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 8b522482-66ab-4ae4-b851-9e4b74433fe6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 85425c37-c0b8-45c3-ae72-0480730a1979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f9115af6-8ae3-4e97-9eba-94dab733147f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a8f6e50a-7930-41b5-b01d-9364a8061593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:49:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:49:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:49:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-changed-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:49:15 user nova-compute[74075]: DEBUG nova.compute.manager [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Refreshing instance network info cache due to event network-changed-24efb4af-953d-40b6-abdd-a7c2c381941a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:49:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] Acquiring lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:49:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] Acquired lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:49:15 user nova-compute[74075]: DEBUG nova.network.neutron [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Refreshing network info cache for port 24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updated VIF entry in instance network info cache for port 24efb4af-953d-40b6-abdd-a7c2c381941a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating instance_info_cache with network_info: [{"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c99d674e-40ac-46d1-b1fb-5ba4740ff59c req-07d31ebb-72ec-4f11-9d87-4ff8f4d92a4b service nova] Releasing lock "refresh_cache-85425c37-c0b8-45c3-ae72-0480730a1979" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'flavor' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:16 user nova-compute[74075]: INFO nova.compute.manager [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attaching volume 0b2a626d-5bb1-430a-820e-18b7c0cc307d to /dev/vdb
Oct 26 09:49:16 user nova-compute[74075]: DEBUG os_brick.utils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0332e0-130e-43ed-acdd-06100500fa95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1807d012-3deb-4fb7-845e-e16db40b414c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a8299-1a2c-472f-bf6d-e751e4622c1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[122aeea4-3624-4d07-afff-d8bb235a4b1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:49:16 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:49:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[438c06e2-ed58-4bea-87e0-7eaa6eeb3b73]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG os_brick.utils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:16 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating existing volume attachment record: 6e4fe135-c61d-4929-b960-f36adf402e90 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:49:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:17 user nova-compute[74075]: INFO nova.compute.manager [None req-a8955045-54cc-4eb3-8fb1-684e1f9c183e tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Get console output
Oct 26 09:49:18 user nova-compute[74075]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 26 09:49:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bodLiMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:18 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:49:18 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:49:18 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974de3b-57d1-4afa-b1eb-e89b964d5603]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:49:18 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[716917f9-1df9-42ba-bacd-03a8345a85f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625] added
Oct 26 09:49:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8148d4-17b9-4dbb-bb63-06d2e4f1019c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03e23ba-d3c7-4e59-87c0-4de3819fabbc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bodLiMXR {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bodLiMXR" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe06c01-05fa-4913-adf4-40d52ecf6d1c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bodLiMXR'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[accced06-f5c8-4c42-87dd-692c150a0d21]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dac9ba-3acc-4451-86a3-c6ac616e49ea]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd202379-3934-43eb-b4bc-f7082636a4b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260]
Oct 26 09:49:18 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260] successful.
Oct 26 09:49:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1285e2c-4771-4967-a1fd-64e481d15e68]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e86ee97-5e4e-435b-9843-a33bb0eacc64]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:18 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:18 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:18 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:18 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f17f6-e4a4-408e-bbcf-be5961251f3d]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bodLiMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:49:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:49:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26430626531383939', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430626531383939', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:49:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:49:19 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:49:19 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:49:19 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:49:19 user nova-compute[74075]:   <serial>404fece8-f0f9-4706-87c7-ca270c171625</serial>
Oct 26 09:49:19 user nova-compute[74075]: </disk>
Oct 26 09:49:19 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:49:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:49:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:49:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No VIF found with MAC fa:16:3e:7b:13:18, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:49:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8d70d84a-85ea-4d0b-bb1c-7969d4bc1e84 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.653s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:23 user nova-compute[74075]: INFO nova.compute.manager [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Detaching volume 404fece8-f0f9-4706-87c7-ca270c171625
Oct 26 09:49:23 user nova-compute[74075]: INFO nova.virt.block_device [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attempting to driver detach volume 404fece8-f0f9-4706-87c7-ca270c171625 from mountpoint /dev/vdb
Oct 26 09:49:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Attempting to detach device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:49:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:49:23 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:49:23 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:49:23 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:49:23 user nova-compute[74075]:   <serial>404fece8-f0f9-4706-87c7-ca270c171625</serial>
Oct 26 09:49:23 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:49:23 user nova-compute[74075]: </disk>
Oct 26 09:49:23 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:49:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config.
Oct 26 09:49:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:49:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:49:23 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:49:23 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:49:23 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:49:23 user nova-compute[74075]:   <serial>404fece8-f0f9-4706-87c7-ca270c171625</serial>
Oct 26 09:49:23 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:49:23 user nova-compute[74075]: </disk>
Oct 26 09:49:23 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:49:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:49:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-changed-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Refreshing instance network info cache due to event network-changed-29c7fb49-2ee1-430f-b75a-950875012b61. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] Acquiring lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] Acquired lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Refreshing network info cache for port 29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'flavor' on Instance uuid f9115af6-8ae3-4e97-9eba-94dab733147f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updated VIF entry in instance network info cache for port 29c7fb49-2ee1-430f-b75a-950875012b61. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updating instance_info_cache with network_info: [{"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e07b92f5-066c-4aac-a7f4-3f1c5ee9810e req-00156405-ee20-4827-8d61-0939ab2547fd service nova] Releasing lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:35 user nova-compute[74075]: INFO nova.compute.manager [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Attaching volume 554538ae-29be-4a2f-a357-c475b15db023 to /dev/vdb
Oct 26 09:49:35 user nova-compute[74075]: DEBUG os_brick.utils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13f81b-b588-4d8e-a763-c2650f8d6514]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66681873-7f85-4378-97ec-77114e6acf51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0acfd-b0f2-4a1c-b829-0451e36fc49a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[163077e3-dbfb-4d4a-bfea-c63538bd44d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:49:35 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:49:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bd59f-c2f8-4480-8858-50c32642d899]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG os_brick.utils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:35 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updating existing volume attachment record: 20658834-1a37-4254-ae03-9071c0261e56 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQObzHLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:36 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:49:36 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:49:36 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294e488-3008-40da-8c92-2ebe56062df7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:49:36 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c5048-a69e-4ff3-a212-f1d1d9d8d8de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d] added
Oct 26 09:49:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[af402305-15f0-427a-a8d3-e6a057e757ff]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dfd340-2733-407c-8741-ed2d6ef26adc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQObzHLA {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQObzHLA" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a947a93-59fc-472a-8df6-b6227c822a68]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQObzHLA'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b23ba6-25d2-4048-b163-04b386247c70]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee940f2b-414c-465f-b1d0-d6c3f8f40449]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[23235119-e5cb-418f-a200-9a3b1792e368]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260]
Oct 26 09:49:36 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260] successful.
Oct 26 09:49:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c58a35-e4b3-4663-b07b-543cf88c40f7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49fa26-2859-4a36-af02-6f27afacd83b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:49:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:36 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:49:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ffc36-6afe-4e72-a8c7-166c83111b06]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:49:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQObzHLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:49:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:49:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23936636563303534', 'path': '/dev/sde'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936636563303534', 'path': '/dev/sde'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:49:37 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'flavor' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:49:37 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:49:37 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:49:37 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:49:37 user nova-compute[74075]:   <serial>0b2a626d-5bb1-430a-820e-18b7c0cc307d</serial>
Oct 26 09:49:37 user nova-compute[74075]: </disk>
Oct 26 09:49:37 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:49:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No VIF found with MAC fa:16:3e:7c:29:58, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a7a94c2c-8b62-4cfd-887c-47a0156cd58d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.652s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:38 user nova-compute[74075]: INFO nova.compute.manager [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Terminating instance
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-ed55274b-002f-470c-b1da-b226d7d42e9d req-f46e25cc-d083-4684-9a8d-0483be76cdba service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ed55274b-002f-470c-b1da-b226d7d42e9d req-f46e25cc-d083-4684-9a8d-0483be76cdba service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ed55274b-002f-470c-b1da-b226d7d42e9d req-f46e25cc-d083-4684-9a8d-0483be76cdba service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ed55274b-002f-470c-b1da-b226d7d42e9d req-f46e25cc-d083-4684-9a8d-0483be76cdba service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-ed55274b-002f-470c-b1da-b226d7d42e9d req-f46e25cc-d083-4684-9a8d-0483be76cdba service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-ed55274b-002f-470c-b1da-b226d7d42e9d req-f46e25cc-d083-4684-9a8d-0483be76cdba service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-unplugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Instance destroyed successfully.
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.objects.instance [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'resources' on Instance uuid 8b522482-66ab-4ae4-b851-9e4b74433fe6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-192025782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-192025782',id=20,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:35:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-lxucicnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:37:36Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=8b522482-66ab-4ae4-b851-9e4b74433fe6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "06454434-823c-4a71-a950-ff140c5e2003", "address": "fa:16:3e:ff:da:f9", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06454434-82", "ovs_interfaceid": "06454434-823c-4a71-a950-ff140c5e2003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_vif [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06454434-82, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3210e7b3-2daa-4cba-9a3a-9e65407c34a2) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:39 user nova-compute[74075]: INFO os_vif [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:da:f9,bridge_name='br-int',has_traffic_filtering=True,id=06454434-823c-4a71-a950-ff140c5e2003,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06454434-82')
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cALwitfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:39 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5ca8b-d8dc-4a75-aa6c-4fb4c9e35047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:49:39 user nova-compute[74075]: No targets found.
Oct 26 09:49:39 user nova-compute[74075]: iSNS:
Oct 26 09:49:39 user nova-compute[74075]: No targets found.
Oct 26 09:49:39 user nova-compute[74075]: STATIC:
Oct 26 09:49:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:49:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:49:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625
Oct 26 09:49:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2
Oct 26 09:49:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:39 user nova-compute[74075]: FIRMWARE:
Oct 26 09:49:39 user nova-compute[74075]: No targets found.
Oct 26 09:49:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:49:39 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:49:39 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3b489-1e86-4383-9760-e87db6beae8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa106df-5977-4d35-a7ac-adaf065cc7e5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:39 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:39 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:39 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:49:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 (non-flash)
Oct 26 09:49:39 user nova-compute[74075]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:39 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:39 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:49:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c16e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b45e29-5b0b-4175-8960-f16ff7eaf652]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da17eb0-473e-4190-ab62-43f932bf0b9c]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[24137719-bf75-4eb3-ba59-8c2e807100f7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3430b4-991b-4e13-810f-02a9143f7a03]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c6aed-e6db-45ea-9f09-1a1e20bda9de]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd3b56d-957b-4044-b1b7-cfa9fc7c9bf6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260]
Oct 26 09:49:39 user nova-compute[74075]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2, portal: 172.16.0.220,3260] successful.
Oct 26 09:49:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a945ccc-dbb8-4338-84ee-d7d247be53f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc2054-cb39-42ab-901e-b6136557a3b0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] <== disconnect_volume: return (343ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:49:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Deleting instance files /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6_del
Oct 26 09:49:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Deletion of /opt/stack/data/nova/instances/8b522482-66ab-4ae4-b851-9e4b74433fe6_del complete
Oct 26 09:49:39 user nova-compute[74075]: INFO nova.compute.manager [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 26 09:49:39 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:49:39 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:49:40 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:49:40 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Took 0.47 seconds to deallocate network for instance.
Oct 26 09:49:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-8c48c504-abba-4f71-83a0-e16d5b018c25 req-0c422702-b75f-4a7c-8e82-f7e04f6b6b69 service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-deleted-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:49:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-9c155636-85d0-4e9d-bc77-8730a1dcac6d req-8f464650-7316-4039-bdf8-8c6074513e2f service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:49:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9c155636-85d0-4e9d-bc77-8730a1dcac6d req-8f464650-7316-4039-bdf8-8c6074513e2f service nova] Acquiring lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9c155636-85d0-4e9d-bc77-8730a1dcac6d req-8f464650-7316-4039-bdf8-8c6074513e2f service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9c155636-85d0-4e9d-bc77-8730a1dcac6d req-8f464650-7316-4039-bdf8-8c6074513e2f service nova] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-9c155636-85d0-4e9d-bc77-8730a1dcac6d req-8f464650-7316-4039-bdf8-8c6074513e2f service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] No waiting events found dispatching network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:49:41 user nova-compute[74075]: WARNING nova.compute.manager [req-9c155636-85d0-4e9d-bc77-8730a1dcac6d req-8f464650-7316-4039-bdf8-8c6074513e2f service nova] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Received unexpected event network-vif-plugged-06454434-823c-4a71-a950-ff140c5e2003 for instance with vm_state active and task_state deleting.
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'flavor' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:42 user nova-compute[74075]: INFO nova.compute.manager [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attaching volume c21352d5-a9a6-4dd6-b89e-eade3c2022db to /dev/vdc
Oct 26 09:49:42 user nova-compute[74075]: DEBUG os_brick.utils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eed5b2-338e-4309-a891-33cc035f1bd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b26459d-c400-421e-9668-c9e52f34e019]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e564b-d7da-4c3e-95f2-9a000f669bdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c22f2b-efb5-4e9e-a57c-76d50274974c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:49:42 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:49:42 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4f901-d206-4c01-be0a-8a74d975966d]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG os_brick.utils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:42 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating existing volume attachment record: cfe5be73-2928-4bd0-b141-3008a0da563f {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:49:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 is timed out.
Oct 26 09:49:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config.
Oct 26 09:49:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bodLiMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:49:43 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7aa2af-545c-4651-ae9a-d116ac48d0ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:49:43 user nova-compute[74075]: No targets found.
Oct 26 09:49:43 user nova-compute[74075]: iSNS:
Oct 26 09:49:43 user nova-compute[74075]: No targets found.
Oct 26 09:49:43 user nova-compute[74075]: STATIC:
Oct 26 09:49:43 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:49:43 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:43 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:43 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:49:43 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:43 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:43 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625
Oct 26 09:49:43 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:49:43 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:49:43 user nova-compute[74075]: FIRMWARE:
Oct 26 09:49:43 user nova-compute[74075]: No targets found.
Oct 26 09:49:43 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:49:43 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:49:43 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88acf1fa-0a5d-4b3d-95d1-96c1f22d3f75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce26f4-b4eb-462b-a668-9f8bf1fb8113]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:43 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:43 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:49:43 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:49:43 user nova-compute[74075]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 (non-flash)
Oct 26 09:49:43 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:49:43 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4006e75d-e017-4aad-a0b9-556f27f75b14]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[199bbb2e-ee0c-4d1a-ac4d-6c83ce3adaea]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cbff00-186b-4561-baf0-9df55d4a751b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[051eddaa-6ad6-4aaf-a2ed-63cec1be8ef7]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e3026-81b4-455d-bccc-d45d3f95d176]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f183122-2ac4-4315-90b2-6ce634afa661]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260]
Oct 26 09:49:44 user nova-compute[74075]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625, portal: 172.16.0.220,3260] successful.
Oct 26 09:49:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:404fece8-f0f9-4706-87c7-ca270c171625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7978e0c-658b-4c73-ac95-282554e371c8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== disconnect_volume: return (342ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:49:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:47 user nova-compute[74075]: INFO nova.compute.manager [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 8b522482-66ab-4ae4-b851-9e4b74433fe6] Took 7.22 seconds to detach 1 volumes for instance.
Oct 26 09:49:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:49:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:49:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:47 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:49:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:49:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:47 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Deleted allocations for instance 8b522482-66ab-4ae4-b851-9e4b74433fe6
Oct 26 09:49:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-876dccc2-37d1-4d97-a6f1-1ec2ebddad1d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "8b522482-66ab-4ae4-b851-9e4b74433fe6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.355s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:49:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-changed-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:49:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Refreshing instance network info cache due to event network-changed-9c5c72e8-e807-47ee-8b46-c35b4185965d. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:49:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] Acquiring lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:49:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] Acquired lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:49:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Refreshing network info cache for port 9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:49:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updated VIF entry in instance network info cache for port 9c5c72e8-e807-47ee-8b46-c35b4185965d. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:49:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updating instance_info_cache with network_info: [{"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:49:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f333b951-71cb-4fdf-9924-fff6b3de4b16 req-0ccb39b5-c447-44ec-86ac-96e8c268b256 service nova] Releasing lock "refresh_cache-a8f6e50a-7930-41b5-b01d-9364a8061593" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:49:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:49:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmENTHBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:02 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f8ea7-e8b6-4537-99a9-d840d9c2be27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:50:02 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec3a49-32e5-47bb-af36-1d7f50d5b04b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db] added
Oct 26 09:50:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168959d-48e8-4ba0-be0f-59551a04bb8c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c5163-12a2-4bef-ab78-0448ad0c26d4]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmENTHBk {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmENTHBk" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6503bf5-b8bc-490c-894e-98ac93e026f9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MmENTHBk'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23317a2-94ed-45b7-892b-508ac8678d6a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec3747c-a216-48cd-a782-a60cee8c458c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:02 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:02 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c8b198-e7dc-40c4-984b-eb29a27dc4ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260]
Oct 26 09:50:02 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'flavor' on Instance uuid a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8ae58-f1cb-4166-8a41-db7ca852f669]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Ignoring supplied device name: /dev/vdb
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5389fa04-52a8-4b3a-ae5c-afb2fc53169a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:02 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:02 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:02 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:02 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d914d-40a9-4523-a266-79d5727e79b1]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmENTHBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:02 user nova-compute[74075]: INFO nova.compute.manager [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Attaching volume a47c6e00-bbb4-43ed-a82e-5a360c68de06 to /dev/vdb
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.utils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b151634-da33-4f57-9785-49910a59792a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6691d70-4a57-459a-8116-04981b79c5e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6759cce-e819-469e-8cc5-2957322fe772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb7b87-39ec-4f88-bca0-64c01ff968ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:50:03 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c0ba7-4f86-4ab8-ae8c-a0014bbd0ba2]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.utils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updating existing volume attachment record: c4907db0-1e8c-4c33-81e7-14bb0d41bfaf {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23832646364613363', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832646364613363', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'flavor' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:50:03 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:03 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:50:03 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:50:03 user nova-compute[74075]:   <serial>c21352d5-a9a6-4dd6-b89e-eade3c2022db</serial>
Oct 26 09:50:03 user nova-compute[74075]: </disk>
Oct 26 09:50:03 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-be7019a4-0c6c-41fd-9b7c-274827f7347c tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.840s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URcfvBIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:04 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.012s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:04 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:04 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8aa00-365d-4d15-b99c-0a7e3e255ade]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:50:04 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d66ff6-7621-4295-b44b-3c12cb17c2d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023] added
Oct 26 09:50:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaca0b0-e515-4647-bd21-fc5cb4f4266b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ad412-2a43-48b2-9f9d-ad203974ca14]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URcfvBIO {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URcfvBIO" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[84acd325-2999-4f57-9dbf-8978a9a1a52c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URcfvBIO'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc490fc0-2d0d-42b3-a067-fa53a8bd7502]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28105ca1-48ad-4977-a84c-17a9909f2a4b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] No VIF found with MAC fa:16:3e:7c:29:58, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b183c-2e91-4607-a4b2-d850c5acdd50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260]
Oct 26 09:50:04 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c090c7-7da7-4332-adba-47c5914d4d43]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35cc287-5293-4741-b62d-618a70e8d956]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:04 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3c7f5125-3aa9-4749-bdd3-4b110bab3ab7 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.838s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbe3ba1-ee7f-4a29-b5af-2d95678a519c]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:50:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URcfvBIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23037643631326231', 'path': '/dev/sdd'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037643631326231', 'path': '/dev/sdd'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:50:05 user nova-compute[74075]: INFO nova.compute.manager [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Detaching volume c21352d5-a9a6-4dd6-b89e-eade3c2022db
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'flavor' on Instance uuid f9115af6-8ae3-4e97-9eba-94dab733147f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:50:05 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:05 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:50:05 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:05 user nova-compute[74075]:   <serial>554538ae-29be-4a2f-a357-c475b15db023</serial>
Oct 26 09:50:05 user nova-compute[74075]: </disk>
Oct 26 09:50:05 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:50:05 user nova-compute[74075]: INFO nova.virt.block_device [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attempting to driver detach volume c21352d5-a9a6-4dd6-b89e-eade3c2022db from mountpoint /dev/vdc
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Attempting to detach device vdc from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:05 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:05 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:50:05 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:50:05 user nova-compute[74075]:   <serial>c21352d5-a9a6-4dd6-b89e-eade3c2022db</serial>
Oct 26 09:50:05 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 09:50:05 user nova-compute[74075]: </disk>
Oct 26 09:50:05 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Successfully detached device vdc from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the persistent domain config.
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:50:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:05 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:05 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:50:05 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:50:05 user nova-compute[74075]:   <serial>c21352d5-a9a6-4dd6-b89e-eade3c2022db</serial>
Oct 26 09:50:05 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 09:50:05 user nova-compute[74075]: </disk>
Oct 26 09:50:05 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:50:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:06 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] No VIF found with MAC fa:16:3e:34:ae:a8, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:50:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6f14bbbf-2a47-4cee-bc9b-67b0b91275b4 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.279s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:08 user nova-compute[74075]: INFO nova.compute.manager [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Detaching volume 554538ae-29be-4a2f-a357-c475b15db023
Oct 26 09:50:08 user nova-compute[74075]: INFO nova.virt.block_device [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Attempting to driver detach volume 554538ae-29be-4a2f-a357-c475b15db023 from mountpoint /dev/vdb
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Attempting to detach device vdb from instance f9115af6-8ae3-4e97-9eba-94dab733147f from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:08 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:08 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:50:08 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:08 user nova-compute[74075]:   <serial>554538ae-29be-4a2f-a357-c475b15db023</serial>
Oct 26 09:50:08 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:50:08 user nova-compute[74075]: </disk>
Oct 26 09:50:08 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully detached device vdb from instance f9115af6-8ae3-4e97-9eba-94dab733147f from the persistent domain config.
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9115af6-8ae3-4e97-9eba-94dab733147f from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:08 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:08 user nova-compute[74075]:   <source dev="/dev/sdd"/>
Oct 26 09:50:08 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:08 user nova-compute[74075]:   <serial>554538ae-29be-4a2f-a357-c475b15db023</serial>
Oct 26 09:50:08 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:50:08 user nova-compute[74075]: </disk>
Oct 26 09:50:08 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [{"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-58346cfe-b396-4dbf-9a7a-b166f73fdb0e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:50:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9115af6-8ae3-4e97-9eba-94dab733147f {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:09 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:50:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=7890MB free_disk=25.05493927001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 85425c37-c0b8-45c3-ae72-0480730a1979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f9115af6-8ae3-4e97-9eba-94dab733147f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a8f6e50a-7930-41b5-b01d-9364a8061593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:50:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:50:13 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:50:13 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:50:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:50:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.795s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:50:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:18 user nova-compute[74075]: INFO nova.compute.manager [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Terminating instance
Oct 26 09:50:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-4eead762-1df1-4d11-9362-cc7f53d2f65c req-da127041-d0d9-4518-bc52-22f472a1b4b1 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-unplugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4eead762-1df1-4d11-9362-cc7f53d2f65c req-da127041-d0d9-4518-bc52-22f472a1b4b1 service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4eead762-1df1-4d11-9362-cc7f53d2f65c req-da127041-d0d9-4518-bc52-22f472a1b4b1 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4eead762-1df1-4d11-9362-cc7f53d2f65c req-da127041-d0d9-4518-bc52-22f472a1b4b1 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-4eead762-1df1-4d11-9362-cc7f53d2f65c req-da127041-d0d9-4518-bc52-22f472a1b4b1 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-unplugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-4eead762-1df1-4d11-9362-cc7f53d2f65c req-da127041-d0d9-4518-bc52-22f472a1b4b1 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-unplugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Instance destroyed successfully.
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'resources' on Instance uuid ff518f36-defb-4f41-aaf0-9a1e5238a20d {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-453913386',display_name='tempest-ServerActionsTestOtherA-server-453913386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-453913386',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:46:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-5gsnb35x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=ff518f36-defb-4f41-aaf0-9a1e5238a20d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "21e585b9-3802-49e4-82f1-0140ea968bc6", "address": "fa:16:3e:2f:52:55", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e585b9-38", "ovs_interfaceid": "21e585b9-3802-49e4-82f1-0140ea968bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_vif [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21e585b9-38, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bcefa91-64a8-4c32-97d2-1c895dc88301) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:50:19 user nova-compute[74075]: INFO os_vif [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:52:55,bridge_name='br-int',has_traffic_filtering=True,id=21e585b9-3802-49e4-82f1-0140ea968bc6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e585b9-38')
Oct 26 09:50:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlYitxXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:19 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f7659-2876-419e-a9f6-673b7d995605]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:50:19 user nova-compute[74075]: No targets found.
Oct 26 09:50:19 user nova-compute[74075]: iSNS:
Oct 26 09:50:19 user nova-compute[74075]: No targets found.
Oct 26 09:50:19 user nova-compute[74075]: STATIC:
Oct 26 09:50:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc
Oct 26 09:50:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023
Oct 26 09:50:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db
Oct 26 09:50:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:19 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:50:19 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:19 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:19 user nova-compute[74075]: FIRMWARE:
Oct 26 09:50:19 user nova-compute[74075]: No targets found.
Oct 26 09:50:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:50:19 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:50:19 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:19 user nova-compute[74075]: INFO nova.compute.manager [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attaching volume d75ea6d3-00ce-4f29-92e4-1df848e26697 to /dev/vdb
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2e16fe-4566-42e6-ab42-b3367709d063]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432f7b8-e420-4e0a-8d2c-86f2903d6b5a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:19 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:19 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:19 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc (non-flash)
Oct 26 09:50:19 user nova-compute[74075]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:19 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:19 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:19 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:19 user nova-compute[74075]: DEBUG os_brick.utils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06b739d-79a8-4f46-b2f6-61e42694ec62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[297754d3-fcca-4f7b-a11b-d2458ab33295]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b8ceb-6d8b-41b7-96a0-08a9becc1bf9]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa7be28-f2e5-44b5-9c94-b32ed863093f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85db28-c6a2-4bf0-ad97-be8dc59c3f98]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c93308b-54e0-4e62-91ae-63a3ad5f88b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f06591-348d-439c-baf0-98fea9fd07e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b7a7d8-df1a-4df2-ad5d-a69d531bea48]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:50:20 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92f991-4d29-4a84-9552-007891a2ef38]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.utils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating existing volume attachment record: 163bdd6d-d2fe-4329-a4b0-902fba87120d {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b909f73-b46d-4b7c-b989-200e40655c50]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4722c11e-c2cd-4a43-9a8c-60f5d07632a6]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260]
Oct 26 09:50:20 user nova-compute[74075]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111e0af2-260c-4de2-850a-51224f1d70dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b217491-af5c-42ac-a40f-58e9ce67b366]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] <== disconnect_volume: return (395ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:50:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Deleting instance files /opt/stack/data/nova/instances/ff518f36-defb-4f41-aaf0-9a1e5238a20d_del
Oct 26 09:50:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Deletion of /opt/stack/data/nova/instances/ff518f36-defb-4f41-aaf0-9a1e5238a20d_del complete
Oct 26 09:50:20 user nova-compute[74075]: INFO nova.compute.manager [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 26 09:50:20 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:50:20 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:50:21 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Took 0.76 seconds to deallocate network for instance.
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-70ec456b-0ddd-4276-8ad2-ac2607e8bca9 req-ada98fef-d26c-413b-9fde-f0024f50b6bd service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-deleted-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:21 user nova-compute[74075]: INFO nova.compute.manager [req-70ec456b-0ddd-4276-8ad2-ac2607e8bca9 req-ada98fef-d26c-413b-9fde-f0024f50b6bd service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Neutron deleted interface 21e585b9-3802-49e4-82f1-0140ea968bc6; detaching it from the instance and deleting it from the info cache
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.network.neutron [req-70ec456b-0ddd-4276-8ad2-ac2607e8bca9 req-ada98fef-d26c-413b-9fde-f0024f50b6bd service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-70ec456b-0ddd-4276-8ad2-ac2607e8bca9 req-ada98fef-d26c-413b-9fde-f0024f50b6bd service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Detach interface failed, port_id=21e585b9-3802-49e4-82f1-0140ea968bc6, reason: Instance ff518f36-defb-4f41-aaf0-9a1e5238a20d could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-87806c73-8f31-41e1-b4ff-e3b812301c4b req-c2c554de-6edc-4b2a-a1df-b301f7d3e8b9 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-87806c73-8f31-41e1-b4ff-e3b812301c4b req-c2c554de-6edc-4b2a-a1df-b301f7d3e8b9 service nova] Acquiring lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-87806c73-8f31-41e1-b4ff-e3b812301c4b req-c2c554de-6edc-4b2a-a1df-b301f7d3e8b9 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-87806c73-8f31-41e1-b4ff-e3b812301c4b req-c2c554de-6edc-4b2a-a1df-b301f7d3e8b9 service nova] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-87806c73-8f31-41e1-b4ff-e3b812301c4b req-c2c554de-6edc-4b2a-a1df-b301f7d3e8b9 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] No waiting events found dispatching network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:50:21 user nova-compute[74075]: WARNING nova.compute.manager [req-87806c73-8f31-41e1-b4ff-e3b812301c4b req-c2c554de-6edc-4b2a-a1df-b301f7d3e8b9 service nova] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Received unexpected event network-vif-plugged-21e585b9-3802-49e4-82f1-0140ea968bc6 for instance with vm_state active and task_state deleting.
Oct 26 09:50:21 user nova-compute[74075]: INFO nova.compute.manager [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Took 0.84 seconds to detach 1 volumes for instance.
Oct 26 09:50:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: ff518f36-defb-4f41-aaf0-9a1e5238a20d] Deleting volume: 111e0af2-260c-4de2-850a-51224f1d70dc {{(pid=74075) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:22 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Deleted allocations for instance ff518f36-defb-4f41-aaf0-9a1e5238a20d
Oct 26 09:50:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3f5b281e-4218-423d-9be9-4419116f519a tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "ff518f36-defb-4f41-aaf0-9a1e5238a20d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.652s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXkAnbRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:23 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:23 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:23 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c5b247-3ded-447f-9e64-9d925498ec47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:50:23 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafc320-16cc-463f-8bc9-af7b87d65c92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06] added
Oct 26 09:50:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f2af5c-d7f4-4898-8560-e6da3ae56eb5]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb62cee-2eb2-4053-897c-fe6750ff5d97]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXkAnbRF {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXkAnbRF" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c2c9a2-2ad6-4d17-90c0-d5f97ad074a0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXkAnbRF'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d7b6e5-db1a-479d-8cae-3c1b446e353b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d05704-3d40-427f-8051-75b698c61e62]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d6b40-a16a-4798-bbd5-bfb968f41f3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260]
Oct 26 09:50:23 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ddb1e-367a-4427-9104-f19baadbe580]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[da404c13-533d-48aa-9c40-59c1d25b91dd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:23 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e75bee-1e91-490a-93c5-2d57d49ab756]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:50:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXkAnbRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:50:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23261613235323136', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261613235323136', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:50:24 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'flavor' on Instance uuid a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:24 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:50:24 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:24 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:50:24 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:24 user nova-compute[74075]:   <serial>a47c6e00-bbb4-43ed-a82e-5a360c68de06</serial>
Oct 26 09:50:24 user nova-compute[74075]: </disk>
Oct 26 09:50:24 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:50:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:25 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No VIF found with MAC fa:16:3e:96:4e:61, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:50:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d918e7e9-69b6-434a-8a9d-7a37a6c26b3d tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.346s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:26 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 85425c37-c0b8-45c3-ae72-0480730a1979 is timed out.
Oct 26 09:50:26 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Successfully detached device vdc from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the live domain config.
Oct 26 09:50:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmENTHBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:26 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac6d04-8c78-4d9d-bbce-599784dcd313]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:50:26 user nova-compute[74075]: No targets found.
Oct 26 09:50:26 user nova-compute[74075]: iSNS:
Oct 26 09:50:26 user nova-compute[74075]: No targets found.
Oct 26 09:50:26 user nova-compute[74075]: STATIC:
Oct 26 09:50:26 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06
Oct 26 09:50:26 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:26 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:26 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023
Oct 26 09:50:26 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:26 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:26 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db
Oct 26 09:50:26 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:26 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:26 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:50:26 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:26 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:26 user nova-compute[74075]: FIRMWARE:
Oct 26 09:50:26 user nova-compute[74075]: No targets found.
Oct 26 09:50:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:50:26 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:50:26 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d374d16-9e3c-49a9-983f-1fd1de8a170e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e96fd3-e140-41e7-974d-3fedf19fab2f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:26 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:26 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:26 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:26 user nova-compute[74075]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db (non-flash)
Oct 26 09:50:26 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:26 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ce387-92d1-4e72-b636-dfc1c69fb96f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd407c-4ecf-4b61-beca-c33f93401fc2]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0145e31b-75b1-479e-8466-25228ee28b63]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[45387acb-95d4-4b35-bbd2-9dc7f03189ea]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[be777709-4507-416b-a010-7b20c535f98f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f3149-b3e6-43eb-b53f-5df6f6f76d7b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260]
Oct 26 09:50:26 user nova-compute[74075]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:26 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21352d5-a9a6-4dd6-b89e-eade3c2022db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2819a-0d29-4b50-8a71-cdee37af6a75]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] <== disconnect_volume: return (319ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:26 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:50:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'flavor' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8a5a4e02-bf0e-46ae-8988-88553c60b523 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9115af6-8ae3-4e97-9eba-94dab733147f is timed out.
Oct 26 09:50:29 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully detached device vdb from instance f9115af6-8ae3-4e97-9eba-94dab733147f from the live domain config.
Oct 26 09:50:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URcfvBIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:29 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab92d50-f816-4076-8a6b-9815beb35713]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:50:29 user nova-compute[74075]: No targets found.
Oct 26 09:50:29 user nova-compute[74075]: iSNS:
Oct 26 09:50:29 user nova-compute[74075]: No targets found.
Oct 26 09:50:29 user nova-compute[74075]: STATIC:
Oct 26 09:50:29 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06
Oct 26 09:50:29 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:29 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:29 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023
Oct 26 09:50:29 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:29 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:29 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:50:29 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:50:29 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:50:29 user nova-compute[74075]: FIRMWARE:
Oct 26 09:50:29 user nova-compute[74075]: No targets found.
Oct 26 09:50:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:50:29 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:50:29 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe26d1-7c8d-4e37-b952-ccddb5b10173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e4eb82-38e5-49d4-b21d-a372326f4a99]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:29 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:29 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:29 user nova-compute[74075]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 (non-flash)
Oct 26 09:50:29 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c13be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023'): ({'sdd'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Removing single pathed devices sdd {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2ad701-a729-4fd7-8b70-6af5f3961196]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f1e4b-812c-45f3-8dee-a8f5af550186]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Flushing IO for device /dev/sdd {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b41fe54-25ef-4579-97f7-9b6c3af2f6dd]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4172178-c826-4257-8d6a-703b76f36825]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] SCSI volumes sdd have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[29148d84-f8a8-482d-a7ca-99aa19fcfbeb]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5087cfe-f231-4a03-a8d5-eb96ec035f0b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260]
Oct 26 09:50:29 user nova-compute[74075]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554538ae-29be-4a2f-a357-c475b15db023 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b683da10-1712-4e51-8b37-601bde65ca22]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] <== disconnect_volume: return (348ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:29 user nova-compute[74075]: INFO nova.compute.manager [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Terminating instance
Oct 26 09:50:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-42118bdd-72dc-439b-a0d8-93a0497bc947 req-55a7664b-4fb7-4fc6-8639-26b35db4368c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-unplugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-42118bdd-72dc-439b-a0d8-93a0497bc947 req-55a7664b-4fb7-4fc6-8639-26b35db4368c service nova] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-42118bdd-72dc-439b-a0d8-93a0497bc947 req-55a7664b-4fb7-4fc6-8639-26b35db4368c service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-42118bdd-72dc-439b-a0d8-93a0497bc947 req-55a7664b-4fb7-4fc6-8639-26b35db4368c service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-42118bdd-72dc-439b-a0d8-93a0497bc947 req-55a7664b-4fb7-4fc6-8639-26b35db4368c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] No waiting events found dispatching network-vif-unplugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-42118bdd-72dc-439b-a0d8-93a0497bc947 req-55a7664b-4fb7-4fc6-8639-26b35db4368c service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-unplugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:50:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Instance destroyed successfully.
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.objects.instance [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lazy-loading 'resources' on Instance uuid 30d9df05-0182-4fb0-8a03-10d47bc7b0a2 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1492139127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1492139127',id=12,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:30:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abf8f091fdd04a9c8e5b14632402efae',ramdisk_id='',reservation_id='r-dxzt7m7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:31:57Z,user_data=None,user_id='f05e6ea9a6e248e892fb237a31d4b1a1',uuid=30d9df05-0182-4fb0-8a03-10d47bc7b0a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converting VIF {"id": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "address": "fa:16:3e:2d:8e:f8", "network": {"id": "7fe3dde1-df96-4635-9a88-56355b08ad77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1807429631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abf8f091fdd04a9c8e5b14632402efae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb205118a-cc", "ovs_interfaceid": "b205118a-ccc4-4fb4-bc46-5d0c0ab3702e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG os_vif [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb205118a-cc, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08bee515-d228-4a84-8649-56c54d11c634) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: INFO os_vif [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:8e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b205118a-ccc4-4fb4-bc46-5d0c0ab3702e,network=Network(7fe3dde1-df96-4635-9a88-56355b08ad77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb205118a-cc')
Oct 26 09:50:30 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Deleting instance files /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2_del
Oct 26 09:50:30 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Deletion of /opt/stack/data/nova/instances/30d9df05-0182-4fb0-8a03-10d47bc7b0a2_del complete
Oct 26 09:50:30 user nova-compute[74075]: INFO nova.compute.manager [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 09:50:30 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG nova.objects.instance [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'flavor' on Instance uuid f9115af6-8ae3-4e97-9eba-94dab733147f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-7f4a31dd-0fae-4821-ac24-8154ab0d98c3 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.048s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:50:31 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Took 0.82 seconds to deallocate network for instance.
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:31 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Deleted allocations for instance 30d9df05-0182-4fb0-8a03-10d47bc7b0a2
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38d0189b-b488-4222-9ef1-f083f7b26b3d tempest-ServerBootFromVolumeStableRescueTest-1733320520 tempest-ServerBootFromVolumeStableRescueTest-1733320520-project-member] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] No waiting events found dispatching network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:50:31 user nova-compute[74075]: WARNING nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received unexpected event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e for instance with vm_state deleted and task_state None.
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] No waiting events found dispatching network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:50:31 user nova-compute[74075]: WARNING nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received unexpected event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e for instance with vm_state deleted and task_state None.
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Acquiring lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] Lock "30d9df05-0182-4fb0-8a03-10d47bc7b0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] No waiting events found dispatching network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:50:31 user nova-compute[74075]: WARNING nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received unexpected event network-vif-plugged-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e for instance with vm_state deleted and task_state None.
Oct 26 09:50:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-a984881e-3987-4816-985a-f4e7f337f622 req-ca88fe75-b4f0-443c-bd96-c42afafa1b30 service nova] [instance: 30d9df05-0182-4fb0-8a03-10d47bc7b0a2] Received event network-vif-deleted-b205118a-ccc4-4fb4-bc46-5d0c0ab3702e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUcFeZTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:50:39 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:39 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:50:39 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b566a24-9553-4717-9501-6a5720adfb8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:50:39 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd76285-1ae7-456f-8d98-a847fa482c2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697] added
Oct 26 09:50:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3632c-38cb-4870-9555-f8ffb215b5a2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d7bd7d-3cf4-4639-9642-d0557e467d5e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUcFeZTk {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUcFeZTk" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e084bb0-422c-4134-9559-17e2d1e771f7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUcFeZTk'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68e8c4-a4df-40bc-b214-88a1229f7116]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6450ef1d-3dd9-4742-9628-f41a6ddea81c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:39 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:39 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[367bc8e0-2cad-47e7-9d0e-9cc44fb228bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260]
Oct 26 09:50:39 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260] successful.
Oct 26 09:50:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f17940-9680-4011-a20b-de45be395d38]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f3a524-5d28-4c4b-871c-fc1906832bee]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:39 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:39 user nova-compute[74075]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 (non-flash)
Oct 26 09:50:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:50:39 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:50:39 user nova-compute[74075]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 (non-flash)
Oct 26 09:50:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed4fa5c-8739-486a-9de2-7fb71ce7fa64]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:50:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUcFeZTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23435643632333861', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435643632333861', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:50:40 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:40 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:50:40 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:40 user nova-compute[74075]:   <serial>d75ea6d3-00ce-4f29-92e4-1df848e26697</serial>
Oct 26 09:50:40 user nova-compute[74075]: </disk>
Oct 26 09:50:40 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No VIF found with MAC fa:16:3e:7b:13:18, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:50:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2798de2f-8984-4680-9587-f77fcdead86e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.977s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:43 user nova-compute[74075]: INFO nova.compute.manager [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Detaching volume d75ea6d3-00ce-4f29-92e4-1df848e26697
Oct 26 09:50:43 user nova-compute[74075]: INFO nova.virt.block_device [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attempting to driver detach volume d75ea6d3-00ce-4f29-92e4-1df848e26697 from mountpoint /dev/vdb
Oct 26 09:50:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Attempting to detach device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:50:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:43 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:43 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:50:43 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:43 user nova-compute[74075]:   <serial>d75ea6d3-00ce-4f29-92e4-1df848e26697</serial>
Oct 26 09:50:43 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:50:43 user nova-compute[74075]: </disk>
Oct 26 09:50:43 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config.
Oct 26 09:50:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:50:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:43 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:43 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:50:43 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:43 user nova-compute[74075]:   <serial>d75ea6d3-00ce-4f29-92e4-1df848e26697</serial>
Oct 26 09:50:43 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:50:43 user nova-compute[74075]: </disk>
Oct 26 09:50:43 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:50:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:50:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:55 user nova-compute[74075]: INFO nova.compute.manager [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Detaching volume 0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:50:55 user nova-compute[74075]: INFO nova.virt.block_device [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Attempting to driver detach volume 0b2a626d-5bb1-430a-820e-18b7c0cc307d from mountpoint /dev/vdb
Oct 26 09:50:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Attempting to detach device vdb from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:50:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:56 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:56 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:50:56 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:56 user nova-compute[74075]:   <serial>0b2a626d-5bb1-430a-820e-18b7c0cc307d</serial>
Oct 26 09:50:56 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:50:56 user nova-compute[74075]: </disk>
Oct 26 09:50:56 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Successfully detached device vdb from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the persistent domain config.
Oct 26 09:50:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:50:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:50:56 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:50:56 user nova-compute[74075]:   <source dev="/dev/sde"/>
Oct 26 09:50:56 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:50:56 user nova-compute[74075]:   <serial>0b2a626d-5bb1-430a-820e-18b7c0cc307d</serial>
Oct 26 09:50:56 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:50:56 user nova-compute[74075]: </disk>
Oct 26 09:50:56 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:50:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-changed-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG nova.compute.manager [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Refreshing instance network info cache due to event network-changed-29c7fb49-2ee1-430f-b75a-950875012b61. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] Acquiring lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] Acquired lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG nova.network.neutron [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Refreshing network info cache for port 29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:50:59 user nova-compute[74075]: INFO nova.compute.manager [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Terminating instance
Oct 26 09:50:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:50:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Instance destroyed successfully.
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'resources' on Instance uuid f9115af6-8ae3-4e97-9eba-94dab733147f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1196659873',display_name='tempest-TestStampPattern-server-1196659873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1196659873',id=38,image_ref='85bc8e5d-b5a1-4d67-b19a-362fa930b5fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUoA12fFzyxIidWvPzA82JwSs6uEZAWp7RKvuuCfDblrhjd6DrukV5OsNKW8Bc7RGvFWptS9TUXTjs7p+Xhq0qIjtUzg1YR7CMjVI5cXK132AArebr/4HHM8dfFtXG1w==',key_name='tempest-TestStampPattern-418773924',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:47:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53cb49aac77047538029297c23344641',ramdisk_id='',reservation_id='r-b4189hue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b73b245a-454a-4082-87e1-2f759341a7a7',image_min_disk='1',image_min_ram='0',image_owner_id='53cb49aac77047538029297c23344641',image_owner_project_name='tempest-TestStampPattern-1997579810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1997579810-project-member',image_user_id='cf9ff8178c904ceea3b85d797650a304',owner_project_name='tempest-TestStampPattern-1997579810',owner_user_name='tempest-TestStampPattern-1997579810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:47:50Z,user_data=None,user_id='cf9ff8178c904ceea3b85d797650a304',uuid=f9115af6-8ae3-4e97-9eba-94dab733147f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converting VIF {"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG os_vif [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29c7fb49-2e, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5d0b846-21a3-4d30-aa2b-847c0f80c3f8) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:00 user nova-compute[74075]: INFO os_vif [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:ae:a8,bridge_name='br-int',has_traffic_filtering=True,id=29c7fb49-2ee1-430f-b75a-950875012b61,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c7fb49-2e')
Oct 26 09:51:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Deleting instance files /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f_del
Oct 26 09:51:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Deletion of /opt/stack/data/nova/instances/f9115af6-8ae3-4e97-9eba-94dab733147f_del complete
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-45feb678-bd66-45ad-9683-32e63701a9ee req-5ee20895-c0af-4bc1-960a-0c38f218f372 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-vif-unplugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-45feb678-bd66-45ad-9683-32e63701a9ee req-5ee20895-c0af-4bc1-960a-0c38f218f372 service nova] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-45feb678-bd66-45ad-9683-32e63701a9ee req-5ee20895-c0af-4bc1-960a-0c38f218f372 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-45feb678-bd66-45ad-9683-32e63701a9ee req-5ee20895-c0af-4bc1-960a-0c38f218f372 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-45feb678-bd66-45ad-9683-32e63701a9ee req-5ee20895-c0af-4bc1-960a-0c38f218f372 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] No waiting events found dispatching network-vif-unplugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-45feb678-bd66-45ad-9683-32e63701a9ee req-5ee20895-c0af-4bc1-960a-0c38f218f372 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-vif-unplugged-29c7fb49-2ee1-430f-b75a-950875012b61 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:51:00 user nova-compute[74075]: INFO nova.compute.manager [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updated VIF entry in instance network info cache for port 29c7fb49-2ee1-430f-b75a-950875012b61. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updating instance_info_cache with network_info: [{"id": "29c7fb49-2ee1-430f-b75a-950875012b61", "address": "fa:16:3e:34:ae:a8", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c7fb49-2e", "ovs_interfaceid": "29c7fb49-2ee1-430f-b75a-950875012b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1d70a53f-5f9d-4767-8ba0-ec1568ae36b9 req-e877d303-a7ca-491b-87c8-fe38fde7d580 service nova] Releasing lock "refresh_cache-f9115af6-8ae3-4e97-9eba-94dab733147f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:00 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Took 0.55 seconds to deallocate network for instance.
Oct 26 09:51:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-b62e9200-b604-41fd-a27d-99e9ec99cdd4 req-6b27056b-8302-4b86-a691-42bfe5ad7d26 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-vif-deleted-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:01 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:51:01 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:51:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:01 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Deleted allocations for instance f9115af6-8ae3-4e97-9eba-94dab733147f
Oct 26 09:51:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5d7c87b6-d701-4c0d-a659-4ed1f0af1ff8 tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.857s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d294074-d345-4a8d-b71d-ad25003deec4 req-9ff2ac16-4d48-44d5-a3ed-0a45ecfd2077 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received event network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d294074-d345-4a8d-b71d-ad25003deec4 req-9ff2ac16-4d48-44d5-a3ed-0a45ecfd2077 service nova] Acquiring lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d294074-d345-4a8d-b71d-ad25003deec4 req-9ff2ac16-4d48-44d5-a3ed-0a45ecfd2077 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d294074-d345-4a8d-b71d-ad25003deec4 req-9ff2ac16-4d48-44d5-a3ed-0a45ecfd2077 service nova] Lock "f9115af6-8ae3-4e97-9eba-94dab733147f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d294074-d345-4a8d-b71d-ad25003deec4 req-9ff2ac16-4d48-44d5-a3ed-0a45ecfd2077 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] No waiting events found dispatching network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:02 user nova-compute[74075]: WARNING nova.compute.manager [req-2d294074-d345-4a8d-b71d-ad25003deec4 req-9ff2ac16-4d48-44d5-a3ed-0a45ecfd2077 service nova] [instance: f9115af6-8ae3-4e97-9eba-94dab733147f] Received unexpected event network-vif-plugged-29c7fb49-2ee1-430f-b75a-950875012b61 for instance with vm_state deleted and task_state None.
Oct 26 09:51:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 is timed out.
Oct 26 09:51:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config.
Oct 26 09:51:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:51:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUcFeZTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:51:03 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:51:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:51:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa1d5b-9664-44dd-ac1f-5417fce8a21b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:51:04 user nova-compute[74075]: No targets found.
Oct 26 09:51:04 user nova-compute[74075]: iSNS:
Oct 26 09:51:04 user nova-compute[74075]: No targets found.
Oct 26 09:51:04 user nova-compute[74075]: STATIC:
Oct 26 09:51:04 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697
Oct 26 09:51:04 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:51:04 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:51:04 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06
Oct 26 09:51:04 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:51:04 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:51:04 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:51:04 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:51:04 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:51:04 user nova-compute[74075]: FIRMWARE:
Oct 26 09:51:04 user nova-compute[74075]: No targets found.
Oct 26 09:51:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:51:04 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:51:04 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[45690465-b344-4d23-825d-1db3302dd18a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[62709b54-4d9b-456a-a783-0b9051ccff84]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:51:04 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:51:04 user nova-compute[74075]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 (non-flash)
Oct 26 09:51:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:51:04 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:51:04 user nova-compute[74075]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 (non-flash)
Oct 26 09:51:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c281000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd088dd-20a5-4a92-a108-8e421354e80f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[99df796c-6407-48b5-a58c-458433f2fe33]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33bcf0-8e98-47b1-887a-eeb984dab7f1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e74913c-eccf-4373-adc4-f4d3774f80e6]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad63da2-7f21-4766-833d-6b39fef73b14]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a4abf-10fe-4271-8d61-67cbf2bf2e70]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260]
Oct 26 09:51:04 user nova-compute[74075]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697, portal: 172.16.0.220,3260] successful.
Oct 26 09:51:04 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75ea6d3-00ce-4f29-92e4-1df848e26697 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[28714602-4593-40a2-b7b0-366d86152b10]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== disconnect_volume: return (296ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:51:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:51:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e6833f86-d27e-4e4d-810e-07bb5a072c9e tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.940s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 58346cfe-b396-4dbf-9a7a-b166f73fdb0e {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:51:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8336MB free_disk=25.170482635498047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 85425c37-c0b8-45c3-ae72-0480730a1979 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a8f6e50a-7930-41b5-b01d-9364a8061593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:51:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:51:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 85425c37-c0b8-45c3-ae72-0480730a1979 is timed out.
Oct 26 09:51:16 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Successfully detached device vdb from instance 85425c37-c0b8-45c3-ae72-0480730a1979 from the live domain config.
Oct 26 09:51:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQObzHLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:51:16 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[20505a4d-8489-44a0-8f85-e223dccdbe62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:51:16 user nova-compute[74075]: No targets found.
Oct 26 09:51:16 user nova-compute[74075]: iSNS:
Oct 26 09:51:16 user nova-compute[74075]: No targets found.
Oct 26 09:51:16 user nova-compute[74075]: STATIC:
Oct 26 09:51:16 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06
Oct 26 09:51:16 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:51:16 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:51:16 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d
Oct 26 09:51:16 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:51:16 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:51:16 user nova-compute[74075]: FIRMWARE:
Oct 26 09:51:16 user nova-compute[74075]: No targets found.
Oct 26 09:51:16 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:51:16 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:51:16 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a9bbfa-1065-472a-90d7-e5b55ebc1a79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[902785bd-ecdf-4832-8e00-3bfa195f6c1c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:51:16 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:51:16 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d (non-flash)
Oct 26 09:51:16 user nova-compute[74075]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:51:16 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c16caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d'): ({'sde'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Removing single pathed devices sde {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d02ea5-cced-405a-a21c-75dfce77bdbc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[32590156-ffc3-4001-8738-df100b42898c]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Flushing IO for device /dev/sde {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a93e80c-d85c-4e79-b16a-f873b8a5286a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fec295-7285-4656-9bb1-b8c698867266]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] SCSI volumes sde have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb27734-5460-46e6-b63e-67a30967a9ee]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3eb998-2548-40f2-99ee-34c71ca5dda1]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260]
Oct 26 09:51:16 user nova-compute[74075]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d, portal: 172.16.0.220,3260] successful.
Oct 26 09:51:16 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a626d-5bb1-430a-820e-18b7c0cc307d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de376ba-0e12-4e65-82dd-8869c9016033]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] <== disconnect_volume: return (292ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:51:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:51:17 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'flavor' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2b6b6656-a128-4250-bab7-53a1fa46437d tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.715s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:20 user nova-compute[74075]: INFO nova.compute.manager [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Terminating instance
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Instance destroyed successfully.
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lazy-loading 'resources' on Instance uuid 58346cfe-b396-4dbf-9a7a-b166f73fdb0e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1140677712',display_name='tempest-ServerActionsTestOtherA-server-1140677712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1140677712',id=16,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DFS+Atdxlu+Ypiqm7Z5C2AgWUScIWV9lo4MQ4viYn3vhR6R30K2qCAm5d/uv450mIT+P5eNOMh4Ed63WsWxeyJ9ki6GNKUyNr7DOA9oTW2zhFltkIyx7OPN6u0CbilQ==',key_name='tempest-keypair-2121306644',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a627b8e169d4a97b075f16e150d972f',ramdisk_id='',reservation_id='r-790sm4hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-546437878',owner_user_name='tempest-ServerActionsTestOtherA-546437878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f5d24fc714c65b3c1a811e5cdf271',uuid=58346cfe-b396-4dbf-9a7a-b166f73fdb0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converting VIF {"id": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "address": "fa:16:3e:a4:d5:22", "network": {"id": "ae3da1f3-dfb5-4cee-be10-3a0300cd2c86", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1804863781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a627b8e169d4a97b075f16e150d972f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e149e6-16", "ovs_interfaceid": "98e149e6-16b9-4b73-b3cb-8db9085814c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG os_vif [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98e149e6-16, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2e85d2c-f225-4a20-b8cf-483fe927fc12) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:20 user nova-compute[74075]: INFO os_vif [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d5:22,bridge_name='br-int',has_traffic_filtering=True,id=98e149e6-16b9-4b73-b3cb-8db9085814c6,network=Network(ae3da1f3-dfb5-4cee-be10-3a0300cd2c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e149e6-16')
Oct 26 09:51:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Deleting instance files /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e_del
Oct 26 09:51:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Deletion of /opt/stack/data/nova/instances/58346cfe-b396-4dbf-9a7a-b166f73fdb0e_del complete
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a09dc4ac-3d6a-4664-bd5d-36fe296b25b6 req-1975e0b3-1151-4f23-840a-71193e0f2c3c service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-vif-unplugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a09dc4ac-3d6a-4664-bd5d-36fe296b25b6 req-1975e0b3-1151-4f23-840a-71193e0f2c3c service nova] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a09dc4ac-3d6a-4664-bd5d-36fe296b25b6 req-1975e0b3-1151-4f23-840a-71193e0f2c3c service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a09dc4ac-3d6a-4664-bd5d-36fe296b25b6 req-1975e0b3-1151-4f23-840a-71193e0f2c3c service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a09dc4ac-3d6a-4664-bd5d-36fe296b25b6 req-1975e0b3-1151-4f23-840a-71193e0f2c3c service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] No waiting events found dispatching network-vif-unplugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-a09dc4ac-3d6a-4664-bd5d-36fe296b25b6 req-1975e0b3-1151-4f23-840a-71193e0f2c3c service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-vif-unplugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:51:20 user nova-compute[74075]: INFO nova.compute.manager [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 26 09:51:20 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:51:20 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:51:21 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:21 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Took 0.58 seconds to deallocate network for instance.
Oct 26 09:51:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:21 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:51:21 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:51:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-97404c93-950e-4db3-a06c-19cb87bf0a38 req-895c0814-d775-48c4-8b9c-857c88577ccb service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-vif-deleted-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:21 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Deleted allocations for instance 58346cfe-b396-4dbf-9a7a-b166f73fdb0e
Oct 26 09:51:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-90fd2a89-83a6-476c-b14e-12385ee84d60 tempest-ServerActionsTestOtherA-546437878 tempest-ServerActionsTestOtherA-546437878-project-member] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.759s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-b00d918e-b05a-4799-abe6-0851fb1c6860 req-40717ffa-0117-4912-a11f-16aecb0a43a9 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received event network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b00d918e-b05a-4799-abe6-0851fb1c6860 req-40717ffa-0117-4912-a11f-16aecb0a43a9 service nova] Acquiring lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b00d918e-b05a-4799-abe6-0851fb1c6860 req-40717ffa-0117-4912-a11f-16aecb0a43a9 service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b00d918e-b05a-4799-abe6-0851fb1c6860 req-40717ffa-0117-4912-a11f-16aecb0a43a9 service nova] Lock "58346cfe-b396-4dbf-9a7a-b166f73fdb0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-b00d918e-b05a-4799-abe6-0851fb1c6860 req-40717ffa-0117-4912-a11f-16aecb0a43a9 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] No waiting events found dispatching network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:23 user nova-compute[74075]: WARNING nova.compute.manager [req-b00d918e-b05a-4799-abe6-0851fb1c6860 req-40717ffa-0117-4912-a11f-16aecb0a43a9 service nova] [instance: 58346cfe-b396-4dbf-9a7a-b166f73fdb0e] Received unexpected event network-vif-plugged-98e149e6-16b9-4b73-b3cb-8db9085814c6 for instance with vm_state deleted and task_state None.
Oct 26 09:51:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:31 user nova-compute[74075]: INFO nova.compute.manager [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Detaching volume a47c6e00-bbb4-43ed-a82e-5a360c68de06
Oct 26 09:51:31 user nova-compute[74075]: INFO nova.virt.block_device [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Attempting to driver detach volume a47c6e00-bbb4-43ed-a82e-5a360c68de06 from mountpoint /dev/vdb
Oct 26 09:51:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Attempting to detach device vdb from instance a8f6e50a-7930-41b5-b01d-9364a8061593 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:51:31 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:51:31 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:51:31 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:51:31 user nova-compute[74075]:   <serial>a47c6e00-bbb4-43ed-a82e-5a360c68de06</serial>
Oct 26 09:51:31 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:51:31 user nova-compute[74075]: </disk>
Oct 26 09:51:31 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully detached device vdb from instance a8f6e50a-7930-41b5-b01d-9364a8061593 from the persistent domain config.
Oct 26 09:51:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8f6e50a-7930-41b5-b01d-9364a8061593 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:51:31 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:51:31 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:51:31 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:51:31 user nova-compute[74075]:   <serial>a47c6e00-bbb4-43ed-a82e-5a360c68de06</serial>
Oct 26 09:51:31 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:51:31 user nova-compute[74075]: </disk>
Oct 26 09:51:31 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:51:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:51:34 user nova-compute[74075]: INFO nova.compute.claims [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Claim successful on node user
Oct 26 09:51:34 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:51:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.policy [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c88b9df9bbd4d09adc2e1846fae72b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f38f50a5217486f935724fd94a0d419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:51:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Creating image(s)
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Successfully created port: fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Cannot resize image /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Ensure instance console log exists: /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Successfully updated port: fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing instance network info cache due to event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance network_info: |[{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Start _get_guest_xml network_info=[{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:51:36 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:51:36 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1236549554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1236549554',id=40,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNnvjCfvPB1KGplHt5oMdZAYISTQd1tvKOHYGMso7wgp/ChdmJeO8r+rIGvadr95UgdgvGGryEjTGo+ffw3ZzkUV1s4zvT8fMaiMy6j5xd4oFV4Z7RQCW4Hgif7AtbAw==',key_name='tempest-keypair-1782388923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-829s1i6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=9149ef7a-dfc7-4cf8-973e-74ef910c3867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'pci_devices' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:51:36 user nova-compute[74075]:   <uuid>9149ef7a-dfc7-4cf8-973e-74ef910c3867</uuid>
Oct 26 09:51:36 user nova-compute[74075]:   <name>instance-00000028</name>
Oct 26 09:51:36 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:51:36 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:51:36 user nova-compute[74075]:   <metadata>
Oct 26 09:51:36 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:51:36 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:51:36 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1236549554</nova:name>
Oct 26 09:51:36 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:51:36</nova:creationTime>
Oct 26 09:51:36 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:51:36 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:51:36 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:51:36 user nova-compute[74075]:       <nova:owner>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:user uuid="1c88b9df9bbd4d09adc2e1846fae72b2">tempest-AttachVolumeShelveTestJSON-85318806-project-member</nova:user>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:project uuid="9f38f50a5217486f935724fd94a0d419">tempest-AttachVolumeShelveTestJSON-85318806</nova:project>
Oct 26 09:51:36 user nova-compute[74075]:       </nova:owner>
Oct 26 09:51:36 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:51:36 user nova-compute[74075]:       <nova:ports>
Oct 26 09:51:36 user nova-compute[74075]:         <nova:port uuid="fcb2810b-ead9-4019-9312-a77cc0d060c9">
Oct 26 09:51:36 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:51:36 user nova-compute[74075]:         </nova:port>
Oct 26 09:51:36 user nova-compute[74075]:       </nova:ports>
Oct 26 09:51:36 user nova-compute[74075]:     </nova:instance>
Oct 26 09:51:36 user nova-compute[74075]:   </metadata>
Oct 26 09:51:36 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:51:36 user nova-compute[74075]:     <system>
Oct 26 09:51:36 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:51:36 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:51:36 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:51:36 user nova-compute[74075]:       <entry name="serial">9149ef7a-dfc7-4cf8-973e-74ef910c3867</entry>
Oct 26 09:51:36 user nova-compute[74075]:       <entry name="uuid">9149ef7a-dfc7-4cf8-973e-74ef910c3867</entry>
Oct 26 09:51:36 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:51:36 user nova-compute[74075]:     </system>
Oct 26 09:51:36 user nova-compute[74075]:   </sysinfo>
Oct 26 09:51:36 user nova-compute[74075]:   <os>
Oct 26 09:51:36 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:51:36 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:51:36 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:51:36 user nova-compute[74075]:   </os>
Oct 26 09:51:36 user nova-compute[74075]:   <features>
Oct 26 09:51:36 user nova-compute[74075]:     <acpi/>
Oct 26 09:51:36 user nova-compute[74075]:     <apic/>
Oct 26 09:51:36 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:51:36 user nova-compute[74075]:   </features>
Oct 26 09:51:36 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:51:36 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:51:36 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:51:36 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:51:36 user nova-compute[74075]:   </clock>
Oct 26 09:51:36 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:51:36 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:51:36 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:51:36 user nova-compute[74075]:   </cpu>
Oct 26 09:51:36 user nova-compute[74075]:   <devices>
Oct 26 09:51:36 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:51:36 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:51:36 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk"/>
Oct 26 09:51:36 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:51:36 user nova-compute[74075]:     </disk>
Oct 26 09:51:36 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:51:36 user nova-compute[74075]:       <mac address="fa:16:3e:f6:d5:94"/>
Oct 26 09:51:36 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:51:36 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:51:36 user nova-compute[74075]:       <target dev="tapfcb2810b-ea"/>
Oct 26 09:51:36 user nova-compute[74075]:     </interface>
Oct 26 09:51:36 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:51:36 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/console.log" append="off"/>
Oct 26 09:51:36 user nova-compute[74075]:     </serial>
Oct 26 09:51:36 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:51:36 user nova-compute[74075]:     <video>
Oct 26 09:51:36 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:51:36 user nova-compute[74075]:     </video>
Oct 26 09:51:36 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:51:36 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:51:36 user nova-compute[74075]:     </rng>
Oct 26 09:51:36 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:51:36 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:51:36 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:51:36 user nova-compute[74075]:     </memballoon>
Oct 26 09:51:36 user nova-compute[74075]:   </devices>
Oct 26 09:51:36 user nova-compute[74075]: </domain>
Oct 26 09:51:36 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1236549554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1236549554',id=40,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNnvjCfvPB1KGplHt5oMdZAYISTQd1tvKOHYGMso7wgp/ChdmJeO8r+rIGvadr95UgdgvGGryEjTGo+ffw3ZzkUV1s4zvT8fMaiMy6j5xd4oFV4Z7RQCW4Hgif7AtbAw==',key_name='tempest-keypair-1782388923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-829s1i6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=9149ef7a-dfc7-4cf8-973e-74ef910c3867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG os_vif [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '271c7322-2e3b-56bf-b41a-7a0643fe1e66', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcb2810b-ea, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcb2810b-ea, col_values=(('qos', UUID('55c9f980-93cf-4b06-bbe4-3961023ac116')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcb2810b-ea, col_values=(('external_ids', {'iface-id': 'fcb2810b-ead9-4019-9312-a77cc0d060c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:d5:94', 'vm-uuid': '9149ef7a-dfc7-4cf8-973e-74ef910c3867'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:36 user nova-compute[74075]: INFO os_vif [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea')
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No VIF found with MAC fa:16:3e:f6:d5:94, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updated VIF entry in instance network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-07b90888-32b7-4576-b40f-d1cbc02835d5 req-2d7d39b8-abaf-4837-85b0-d97fdec03c93 service nova] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:51:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-8e5ceb98-a66a-4f5f-a24c-f59ebe4e61a3 req-14168291-411d-484b-80bb-e819eeaee33a service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8e5ceb98-a66a-4f5f-a24c-f59ebe4e61a3 req-14168291-411d-484b-80bb-e819eeaee33a service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8e5ceb98-a66a-4f5f-a24c-f59ebe4e61a3 req-14168291-411d-484b-80bb-e819eeaee33a service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8e5ceb98-a66a-4f5f-a24c-f59ebe4e61a3 req-14168291-411d-484b-80bb-e819eeaee33a service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-8e5ceb98-a66a-4f5f-a24c-f59ebe4e61a3 req-14168291-411d-484b-80bb-e819eeaee33a service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:38 user nova-compute[74075]: WARNING nova.compute.manager [req-8e5ceb98-a66a-4f5f-a24c-f59ebe4e61a3 req-14168291-411d-484b-80bb-e819eeaee33a service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state building and task_state spawning.
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:39 user nova-compute[74075]: INFO nova.compute.manager [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attaching volume 26c1b04e-981f-4c3f-9eb1-c224d9565767 to /dev/vdb
Oct 26 09:51:39 user nova-compute[74075]: DEBUG os_brick.utils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5d95e-9198-4f04-89c6-49badca18930]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba12bdf-1605-4527-8670-15033684073b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d913a9ee-0ccc-41c1-9fdf-296eedbb581e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d5df1-c01c-42dd-85a9-78e25b69150c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:51:40 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d57df1-50f1-4e71-b3fe-bc2ae7c04a0d]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG os_brick.utils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating existing volume attachment record: 18d9892b-82fa-4cf4-913f-2ec0c589172b {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:51:40 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance spawned successfully.
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-74240918-c09b-46c6-9a0b-d7cd655dc5ba req-8ddb1023-8f1f-40ee-a901-ab26f4b2f51b service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-74240918-c09b-46c6-9a0b-d7cd655dc5ba req-8ddb1023-8f1f-40ee-a901-ab26f4b2f51b service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-74240918-c09b-46c6-9a0b-d7cd655dc5ba req-8ddb1023-8f1f-40ee-a901-ab26f4b2f51b service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-74240918-c09b-46c6-9a0b-d7cd655dc5ba req-8ddb1023-8f1f-40ee-a901-ab26f4b2f51b service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-74240918-c09b-46c6-9a0b-d7cd655dc5ba req-8ddb1023-8f1f-40ee-a901-ab26f4b2f51b service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:40 user nova-compute[74075]: WARNING nova.compute.manager [req-74240918-c09b-46c6-9a0b-d7cd655dc5ba req-8ddb1023-8f1f-40ee-a901-ab26f4b2f51b service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state building and task_state spawning.
Oct 26 09:51:40 user nova-compute[74075]: INFO nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Took 5.13 seconds to spawn the instance on the hypervisor.
Oct 26 09:51:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:51:40 user nova-compute[74075]: INFO nova.compute.manager [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Took 5.83 seconds to build instance.
Oct 26 09:51:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccf2776c-fe18-41d8-942c-f47ff267450a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.921s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:46 user nova-compute[74075]: INFO nova.compute.manager [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Terminating instance
Oct 26 09:51:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-5c85dc86-2d86-4b9c-aee8-65d9b4981292 req-366a7c53-6930-4825-be28-d005dc0cfc90 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-vif-unplugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5c85dc86-2d86-4b9c-aee8-65d9b4981292 req-366a7c53-6930-4825-be28-d005dc0cfc90 service nova] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5c85dc86-2d86-4b9c-aee8-65d9b4981292 req-366a7c53-6930-4825-be28-d005dc0cfc90 service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5c85dc86-2d86-4b9c-aee8-65d9b4981292 req-366a7c53-6930-4825-be28-d005dc0cfc90 service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-5c85dc86-2d86-4b9c-aee8-65d9b4981292 req-366a7c53-6930-4825-be28-d005dc0cfc90 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] No waiting events found dispatching network-vif-unplugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-5c85dc86-2d86-4b9c-aee8-65d9b4981292 req-366a7c53-6930-4825-be28-d005dc0cfc90 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-vif-unplugged-24efb4af-953d-40b6-abdd-a7c2c381941a for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:51:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Instance destroyed successfully.
Oct 26 09:51:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lazy-loading 'resources' on Instance uuid 85425c37-c0b8-45c3-ae72-0480730a1979 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-759500269',display_name='tempest-TestServerVolumeAttachmentScenario-server-759500269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-759500269',id=37,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnEMUQKBeVvbqIvuvZ1ZXuirq2UEwy/GmElg7RwCtzvt25HKvzzRSOl5croNZHbSM6a2Md0WhVv8+x1a0FJPWxPIelfcqcL7MoSLSY0ikyT63w5cenSdNgvHND+ke2iSA==',key_name='tempest-keypair-2072427545',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:47:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28294d57b6c04f64a6b8e97f11e95389',ramdisk_id='',reservation_id='r-n5bxvz9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1760918044',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1760918044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:47:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d292ea326cf940beb182512cf6824950',uuid=85425c37-c0b8-45c3-ae72-0480730a1979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Converting VIF {"id": "24efb4af-953d-40b6-abdd-a7c2c381941a", "address": "fa:16:3e:7c:29:58", "network": {"id": "bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-340392479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28294d57b6c04f64a6b8e97f11e95389", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24efb4af-95", "ovs_interfaceid": "24efb4af-953d-40b6-abdd-a7c2c381941a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG os_vif [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24efb4af-95, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aef9d100-d80a-4988-ace7-d28ffda80e94) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:47 user nova-compute[74075]: INFO os_vif [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:29:58,bridge_name='br-int',has_traffic_filtering=True,id=24efb4af-953d-40b6-abdd-a7c2c381941a,network=Network(bbfd5489-dcb8-4c0c-9de8-016f0ce4a76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24efb4af-95')
Oct 26 09:51:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Deleting instance files /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979_del
Oct 26 09:51:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Deletion of /opt/stack/data/nova/instances/85425c37-c0b8-45c3-ae72-0480730a1979_del complete
Oct 26 09:51:47 user nova-compute[74075]: INFO nova.compute.manager [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 26 09:51:47 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:51:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:48 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Took 0.76 seconds to deallocate network for instance.
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-bc904282-1612-403b-a05b-06e021ad3318 req-fd216f9e-c3e5-47ec-906f-b02e0d43b8f8 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-vif-deleted-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:48 user nova-compute[74075]: INFO nova.compute.manager [req-bc904282-1612-403b-a05b-06e021ad3318 req-fd216f9e-c3e5-47ec-906f-b02e0d43b8f8 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Neutron deleted interface 24efb4af-953d-40b6-abdd-a7c2c381941a; detaching it from the instance and deleting it from the info cache
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.network.neutron [req-bc904282-1612-403b-a05b-06e021ad3318 req-fd216f9e-c3e5-47ec-906f-b02e0d43b8f8 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-bc904282-1612-403b-a05b-06e021ad3318 req-fd216f9e-c3e5-47ec-906f-b02e0d43b8f8 service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Detach interface failed, port_id=24efb4af-953d-40b6-abdd-a7c2c381941a, reason: Instance 85425c37-c0b8-45c3-ae72-0480730a1979 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:48 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Deleted allocations for instance 85425c37-c0b8-45c3-ae72-0480730a1979
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-436ca2ad-9f6d-403e-a27b-6f937faee111 tempest-TestServerVolumeAttachmentScenario-1760918044 tempest-TestServerVolumeAttachmentScenario-1760918044-project-member] Lock "85425c37-c0b8-45c3-ae72-0480730a1979" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-9f6cec9a-2bd9-4783-944d-0dc2d3607eef req-6ecb15d9-02bc-4fdc-b890-a9fcd89c374b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received event network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f6cec9a-2bd9-4783-944d-0dc2d3607eef req-6ecb15d9-02bc-4fdc-b890-a9fcd89c374b service nova] Acquiring lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f6cec9a-2bd9-4783-944d-0dc2d3607eef req-6ecb15d9-02bc-4fdc-b890-a9fcd89c374b service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f6cec9a-2bd9-4783-944d-0dc2d3607eef req-6ecb15d9-02bc-4fdc-b890-a9fcd89c374b service nova] Lock "85425c37-c0b8-45c3-ae72-0480730a1979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:48 user nova-compute[74075]: DEBUG nova.compute.manager [req-9f6cec9a-2bd9-4783-944d-0dc2d3607eef req-6ecb15d9-02bc-4fdc-b890-a9fcd89c374b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] No waiting events found dispatching network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:48 user nova-compute[74075]: WARNING nova.compute.manager [req-9f6cec9a-2bd9-4783-944d-0dc2d3607eef req-6ecb15d9-02bc-4fdc-b890-a9fcd89c374b service nova] [instance: 85425c37-c0b8-45c3-ae72-0480730a1979] Received unexpected event network-vif-plugged-24efb4af-953d-40b6-abdd-a7c2c381941a for instance with vm_state deleted and task_state None.
Oct 26 09:51:51 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8f6e50a-7930-41b5-b01d-9364a8061593 is timed out.
Oct 26 09:51:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully detached device vdb from instance a8f6e50a-7930-41b5-b01d-9364a8061593 from the live domain config.
Oct 26 09:51:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXkAnbRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:51:51 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb97d2a5-13bd-428f-97df-16d89a6dedbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:51:51 user nova-compute[74075]: No targets found.
Oct 26 09:51:51 user nova-compute[74075]: iSNS:
Oct 26 09:51:51 user nova-compute[74075]: No targets found.
Oct 26 09:51:51 user nova-compute[74075]: STATIC:
Oct 26 09:51:51 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06
Oct 26 09:51:51 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:51:51 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:51:51 user nova-compute[74075]: FIRMWARE:
Oct 26 09:51:51 user nova-compute[74075]: No targets found.
Oct 26 09:51:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:51:51 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:51:51 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c5e581-fe3a-4ef2-932f-81ea677dc3f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd61b4f-4531-4a5c-abe6-17cbf64cc6f6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:51:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 (non-flash)
Oct 26 09:51:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb9edd8-9768-442f-96f0-28e633886d19]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527b093-58c7-471b-9c64-96a7b41abfbd]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e98aba-5521-40d5-a284-8236a02e190f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.105s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678edfc-69d1-447c-a4c2-128dc0211f48]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba409ed5-96ec-40fb-a7a4-504efe6b42eb]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9111fe8e-7c00-42bb-9356-2ffc248d31fa]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260]
Oct 26 09:51:51 user nova-compute[74075]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06, portal: 172.16.0.220,3260] successful.
Oct 26 09:51:51 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[388d33da-78df-4379-8ec6-e3670e9796ec]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== disconnect_volume: return (378ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:51:51 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG nova.objects.instance [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'flavor' on Instance uuid a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-49f317cd-4ef1-42b3-b75e-e53cd4ea9fcb tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.771s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:52 user nova-compute[74075]: INFO nova.compute.manager [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Terminating instance
Oct 26 09:51:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:51:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-0be7428b-3809-42ed-afd2-0c1676c87958 req-30469a09-6f73-467a-84d8-00bd901c8777 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-vif-unplugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0be7428b-3809-42ed-afd2-0c1676c87958 req-30469a09-6f73-467a-84d8-00bd901c8777 service nova] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0be7428b-3809-42ed-afd2-0c1676c87958 req-30469a09-6f73-467a-84d8-00bd901c8777 service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0be7428b-3809-42ed-afd2-0c1676c87958 req-30469a09-6f73-467a-84d8-00bd901c8777 service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-0be7428b-3809-42ed-afd2-0c1676c87958 req-30469a09-6f73-467a-84d8-00bd901c8777 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] No waiting events found dispatching network-vif-unplugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-0be7428b-3809-42ed-afd2-0c1676c87958 req-30469a09-6f73-467a-84d8-00bd901c8777 service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-vif-unplugged-9c5c72e8-e807-47ee-8b46-c35b4185965d for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Instance destroyed successfully.
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'resources' on Instance uuid a8f6e50a-7930-41b5-b01d-9364a8061593 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1734526257',display_name='tempest-VolumesSnapshotTestJSON-instance-1734526257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1734526257',id=39,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyiefyBphypBJ9rmDSmjzOXUQl5yt2P7FE1a+4XKSO4K9ewhcIpR+Zq1DDtjFfKS/OejBlP/8lwuKmOIZ3DUHNKx3UZa6QpMSj2VC6J/oN58K5kN5t7hbnLFkbSJPTBrQ==',key_name='tempest-keypair-507924393',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:48:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02c6280808c74bc29546ad4380d18c00',ramdisk_id='',reservation_id='r-k05705dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1278929434',owner_user_name='tempest-VolumesSnapshotTestJSON-1278929434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b426e1ce287140808e69375cb864c8c1',uuid=a8f6e50a-7930-41b5-b01d-9364a8061593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converting VIF {"id": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "address": "fa:16:3e:96:4e:61", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5c72e8-e8", "ovs_interfaceid": "9c5c72e8-e807-47ee-8b46-c35b4185965d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_vif [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c5c72e8-e8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06b191e9-9456-4976-9b1a-e13354e3ccbd) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:51:53 user nova-compute[74075]: INFO os_vif [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:61,bridge_name='br-int',has_traffic_filtering=True,id=9c5c72e8-e807-47ee-8b46-c35b4185965d,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5c72e8-e8')
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:a47c6e00-bbb4-43ed-a82e-5a360c68de06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXkAnbRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:51:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7fdfca68-830f-4d19-bcd3-ffce63e8f5b9]: Unexpected error while running command.
Oct 26 09:51:53 user nova-compute[74075]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 26 09:51:53 user nova-compute[74075]: Exit code: 21
Oct 26 09:51:53 user nova-compute[74075]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 26 09:51:53 user nova-compute[74075]: Stderr: '' {{(pid=85490) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 26 09:51:53 user nova-compute[74075]: Traceback (most recent call last):
Oct 26 09:51:53 user nova-compute[74075]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 26 09:51:53 user nova-compute[74075]:     ret = func(*f_args, **f_kwargs)
Oct 26 09:51:53 user nova-compute[74075]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 26 09:51:53 user nova-compute[74075]:     return func(*args, **kwargs)
Oct 26 09:51:53 user nova-compute[74075]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 26 09:51:53 user nova-compute[74075]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 26 09:51:53 user nova-compute[74075]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 26 09:51:53 user nova-compute[74075]:     return putils.execute(on_execute=on_execute,
Oct 26 09:51:53 user nova-compute[74075]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 26 09:51:53 user nova-compute[74075]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 26 09:51:53 user nova-compute[74075]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 26 09:51:53 user nova-compute[74075]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 26 09:51:53 user nova-compute[74075]: Exit code: 21
Oct 26 09:51:53 user nova-compute[74075]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 26 09:51:53 user nova-compute[74075]: Stderr: ''
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdfca68-830f-4d19-bcd3-ffce63e8f5b9]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 26 09:51:53 user nova-compute[74075]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 26 09:51:53 user nova-compute[74075]: Exit code: 21
Oct 26 09:51:53 user nova-compute[74075]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 26 09:51:53 user nova-compute[74075]: Stderr: ''
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 26 09:51:53 user nova-compute[74075]: ERROR os_brick.initiator.connectors.iscsi 
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74075) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== disconnect_volume: return (38ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:51:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Deleting instance files /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593_del
Oct 26 09:51:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Deletion of /opt/stack/data/nova/instances/a8f6e50a-7930-41b5-b01d-9364a8061593_del complete
Oct 26 09:51:53 user nova-compute[74075]: INFO nova.compute.manager [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 26 09:51:53 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:51:53 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:51:54 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:51:54 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Took 0.73 seconds to deallocate network for instance.
Oct 26 09:51:54 user nova-compute[74075]: WARNING nova.volume.cinder [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Attachment c4907db0-1e8c-4c33-81e7-14bb0d41bfaf does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c4907db0-1e8c-4c33-81e7-14bb0d41bfaf. (HTTP 404) (Request-ID: req-fa30ba8b-8339-4c01-8a43-f7bd56d1a8f0)
Oct 26 09:51:54 user nova-compute[74075]: INFO nova.compute.manager [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Took 0.02 seconds to detach 1 volumes for instance.
Oct 26 09:51:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:54 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:51:54 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:51:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:54 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Deleted allocations for instance a8f6e50a-7930-41b5-b01d-9364a8061593
Oct 26 09:51:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c2d08fb-5b73-4ea7-8c24-e93ef5eb553e tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] Acquiring lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:51:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:51:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] Lock "a8f6e50a-7930-41b5-b01d-9364a8061593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:51:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] No waiting events found dispatching network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:51:55 user nova-compute[74075]: WARNING nova.compute.manager [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received unexpected event network-vif-plugged-9c5c72e8-e807-47ee-8b46-c35b4185965d for instance with vm_state deleted and task_state None.
Oct 26 09:51:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-ba235d05-8db9-4422-8060-d528573e655e req-f8ad341e-f2ab-4242-9049-42b9772db26f service nova] [instance: a8f6e50a-7930-41b5-b01d-9364a8061593] Received event network-vif-deleted-9c5c72e8-e807-47ee-8b46-c35b4185965d {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:51:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgeBjQkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:51:59 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:51:59 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:51:59 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5746c294-00eb-4ec9-b268-17c17d476ff1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:51:59 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0e9cf-2f42-4ced-9575-e6e3b7be1b63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767] added
Oct 26 09:51:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d42f47-d1c4-453e-885d-dc6143165cce]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6732c48e-6e81-4fcf-aab4-8344703ea090]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgeBjQkw {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgeBjQkw" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d88241-219d-4790-9e50-3ac69d6995f9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgeBjQkw'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6305d442-c53f-4f0e-baa0-87b0348a17c8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5c620e-6b35-4cf8-a319-f881436fa8e1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:51:59 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:51:59 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:51:59 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 09:51:59 user nova-compute[74075]: 
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[276f3ec8-b977-4e37-8dd3-26041bee837d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260]
Oct 26 09:51:59 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260] successful.
Oct 26 09:51:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c175fd95-9df6-47d2-8598-a09f5f8bec19]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66af7d-3efd-4883-ba68-d22d4f7f882b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 (non-flash)
Oct 26 09:51:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 (non-flash)
Oct 26 09:51:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c8338-ebca-46d0-892b-e30b16d68741]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:51:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgeBjQkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26362303137373965', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362303137373965', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:52:00 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:52:00 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:52:00 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:52:00 user nova-compute[74075]:   <serial>26c1b04e-981f-4c3f-9eb1-c224d9565767</serial>
Oct 26 09:52:00 user nova-compute[74075]: </disk>
Oct 26 09:52:00 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] No VIF found with MAC fa:16:3e:7b:13:18, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:52:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4c02a899-9186-4a05-a16d-971817730375 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.100s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:03 user nova-compute[74075]: INFO nova.compute.manager [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Detaching volume 26c1b04e-981f-4c3f-9eb1-c224d9565767
Oct 26 09:52:03 user nova-compute[74075]: INFO nova.virt.block_device [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Attempting to driver detach volume 26c1b04e-981f-4c3f-9eb1-c224d9565767 from mountpoint /dev/vdb
Oct 26 09:52:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Attempting to detach device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:52:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:52:03 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:52:03 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:52:03 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:52:03 user nova-compute[74075]:   <serial>26c1b04e-981f-4c3f-9eb1-c224d9565767</serial>
Oct 26 09:52:03 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:52:03 user nova-compute[74075]: </disk>
Oct 26 09:52:03 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:52:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the persistent domain config.
Oct 26 09:52:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:52:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:52:03 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:52:03 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:52:03 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:52:03 user nova-compute[74075]:   <serial>26c1b04e-981f-4c3f-9eb1-c224d9565767</serial>
Oct 26 09:52:03 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:52:03 user nova-compute[74075]: </disk>
Oct 26 09:52:03 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:52:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:52:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating instance_info_cache with network_info: [{"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-4b80a751-1c08-48c8-a2f4-e6c9ff01d479" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:52:12 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8400MB free_disk=25.32019805908203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-changed-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Refreshing instance network info cache due to event network-changed-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] Acquiring lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] Acquired lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.network.neutron [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Refreshing network info cache for port 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b73b245a-454a-4082-87e1-2f759341a7a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:12 user nova-compute[74075]: INFO nova.compute.manager [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Terminating instance
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-76d37c9b-c547-414a-a282-c547cb443093 req-dacec7ac-604f-4fcf-b7b3-1ba090009908 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-vif-unplugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-76d37c9b-c547-414a-a282-c547cb443093 req-dacec7ac-604f-4fcf-b7b3-1ba090009908 service nova] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-76d37c9b-c547-414a-a282-c547cb443093 req-dacec7ac-604f-4fcf-b7b3-1ba090009908 service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-76d37c9b-c547-414a-a282-c547cb443093 req-dacec7ac-604f-4fcf-b7b3-1ba090009908 service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-76d37c9b-c547-414a-a282-c547cb443093 req-dacec7ac-604f-4fcf-b7b3-1ba090009908 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] No waiting events found dispatching network-vif-unplugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:52:12 user nova-compute[74075]: DEBUG nova.compute.manager [req-76d37c9b-c547-414a-a282-c547cb443093 req-dacec7ac-604f-4fcf-b7b3-1ba090009908 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-vif-unplugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.network.neutron [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updated VIF entry in instance network info cache for port 23b6c2ad-e4c0-4329-bd6a-cbdb3b255568. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.network.neutron [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [{"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:52:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Instance destroyed successfully.
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.objects.instance [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lazy-loading 'resources' on Instance uuid b73b245a-454a-4082-87e1-2f759341a7a7 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-71f41f6b-3f24-4557-8a93-141e20f761b9 req-803fb4d5-28ee-4396-9534-fa47dc15df8f service nova] Releasing lock "refresh_cache-b73b245a-454a-4082-87e1-2f759341a7a7" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-565466708',display_name='tempest-TestStampPattern-server-565466708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-565466708',id=34,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUoA12fFzyxIidWvPzA82JwSs6uEZAWp7RKvuuCfDblrhjd6DrukV5OsNKW8Bc7RGvFWptS9TUXTjs7p+Xhq0qIjtUzg1YR7CMjVI5cXK132AArebr/4HHM8dfFtXG1w==',key_name='tempest-TestStampPattern-418773924',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:44:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53cb49aac77047538029297c23344641',ramdisk_id='',reservation_id='r-4chmx9gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1997579810',owner_user_name='tempest-TestStampPattern-1997579810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:47:40Z,user_data=None,user_id='cf9ff8178c904ceea3b85d797650a304',uuid=b73b245a-454a-4082-87e1-2f759341a7a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converting VIF {"id": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "address": "fa:16:3e:5f:fa:31", "network": {"id": "d844e2a8-d9e9-4c65-9e6f-b439fcf3c003", "bridge": "br-int", "label": "tempest-TestStampPattern-1996287889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53cb49aac77047538029297c23344641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b6c2ad-e4", "ovs_interfaceid": "23b6c2ad-e4c0-4329-bd6a-cbdb3b255568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG os_vif [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23b6c2ad-e4, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc51c2b7-b5e2-48d2-80e0-329750854698) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:52:13 user nova-compute[74075]: INFO os_vif [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fa:31,bridge_name='br-int',has_traffic_filtering=True,id=23b6c2ad-e4c0-4329-bd6a-cbdb3b255568,network=Network(d844e2a8-d9e9-4c65-9e6f-b439fcf3c003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b6c2ad-e4')
Oct 26 09:52:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Deleting instance files /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7_del
Oct 26 09:52:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Deletion of /opt/stack/data/nova/instances/b73b245a-454a-4082-87e1-2f759341a7a7_del complete
Oct 26 09:52:13 user nova-compute[74075]: INFO nova.compute.manager [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 09:52:13 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:52:13 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:52:14 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Took 0.74 seconds to deallocate network for instance.
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:14 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Deleted allocations for instance b73b245a-454a-4082-87e1-2f759341a7a7
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-4d58e95b-da42-416d-8fd7-7edf0b78d5ce tempest-TestStampPattern-1997579810 tempest-TestStampPattern-1997579810-project-member] Lock "b73b245a-454a-4082-87e1-2f759341a7a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-fb41d14e-fc07-4834-b4ae-f23bc2dc0bb7 req-dea580d5-b22f-45c3-b61c-a0066eea825f service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-vif-deleted-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-e2b70947-9ad0-43b3-ab12-103f031045be req-7ab1f659-d184-4fde-b4e2-94d3b7b5a804 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received event network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e2b70947-9ad0-43b3-ab12-103f031045be req-7ab1f659-d184-4fde-b4e2-94d3b7b5a804 service nova] Acquiring lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e2b70947-9ad0-43b3-ab12-103f031045be req-7ab1f659-d184-4fde-b4e2-94d3b7b5a804 service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e2b70947-9ad0-43b3-ab12-103f031045be req-7ab1f659-d184-4fde-b4e2-94d3b7b5a804 service nova] Lock "b73b245a-454a-4082-87e1-2f759341a7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:14 user nova-compute[74075]: DEBUG nova.compute.manager [req-e2b70947-9ad0-43b3-ab12-103f031045be req-7ab1f659-d184-4fde-b4e2-94d3b7b5a804 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] No waiting events found dispatching network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:52:14 user nova-compute[74075]: WARNING nova.compute.manager [req-e2b70947-9ad0-43b3-ab12-103f031045be req-7ab1f659-d184-4fde-b4e2-94d3b7b5a804 service nova] [instance: b73b245a-454a-4082-87e1-2f759341a7a7] Received unexpected event network-vif-plugged-23b6c2ad-e4c0-4329-bd6a-cbdb3b255568 for instance with vm_state deleted and task_state None.
Oct 26 09:52:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:52:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:52:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:52:23 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 is timed out.
Oct 26 09:52:23 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully detached device vdb from instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 from the live domain config.
Oct 26 09:52:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgeBjQkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:52:23 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f80e20-70e5-414e-80a8-b8b744fe9265]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:52:23 user nova-compute[74075]: No targets found.
Oct 26 09:52:23 user nova-compute[74075]: iSNS:
Oct 26 09:52:23 user nova-compute[74075]: No targets found.
Oct 26 09:52:23 user nova-compute[74075]: STATIC:
Oct 26 09:52:23 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767
Oct 26 09:52:23 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:52:23 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:52:23 user nova-compute[74075]: FIRMWARE:
Oct 26 09:52:23 user nova-compute[74075]: No targets found.
Oct 26 09:52:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:52:23 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:52:23 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8cad8-4e58-4721-ae97-f6a65d7a788e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[39975400-9aef-46e4-b1de-eec1c70d4e0f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 (non-flash)
Oct 26 09:52:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 (non-flash)
Oct 26 09:52:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c16f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4195889d-af5f-4779-be3a-91e310454cfc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0baf6f-694f-46a7-bbb9-da4c189adaf0]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd742ab-6b1e-4da4-ad19-a2792909ce14]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0dfa2-19a8-4459-b222-44f022ddd223]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a3163c-1c16-4926-a86b-d29c59736521]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d350826a-444c-47fd-9aa2-b74018dda6be]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260]
Oct 26 09:52:23 user nova-compute[74075]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767, portal: 172.16.0.220,3260] successful.
Oct 26 09:52:23 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c1b04e-981f-4c3f-9eb1-c224d9565767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae0eb17-a0a7-4682-b513-ea96f663b1d8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] <== disconnect_volume: return (270ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:52:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:52:24 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'flavor' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:52:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6579f862-d02b-4fef-8875-fb0fb07aeb4f tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:52:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:52:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:52:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:52:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:52:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:52:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:52:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:06 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:53:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:06 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:53:06 user nova-compute[74075]: INFO nova.compute.claims [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Claim successful on node user
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:53:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.policy [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b426e1ce287140808e69375cb864c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6280808c74bc29546ad4380d18c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:53:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Creating image(s)
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "/opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "/opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "/opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk 1073741824" returned: 0 in 0.056s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Successfully created port: 891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:53:07 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Cannot resize image /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Ensure instance console log exists: /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Successfully updated port: 891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquired lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-changed-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Refreshing instance network info cache due to event network-changed-891fd05d-ab72-4447-87d8-227dd45f905a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] Acquiring lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:53:08 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.neutron [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating instance_info_cache with network_info: [{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Releasing lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Instance network_info: |[{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] Acquired lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Refreshing network info cache for port 891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Start _get_guest_xml network_info=[{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:53:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:53:09 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1616911063',display_name='tempest-VolumesSnapshotTestJSON-instance-1616911063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1616911063',id=41,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc/XvEBz76ESXxVPsBRR2ODgkrgo6XgumaZBcwD21g+guIAyszzlJhdJj1UFO5cSqy04WXJtVRw/kNCRz53j/mFuV7ysT5jQxI+EuKxagovzYSSJUc6+po5KlMub9T9nQ==',key_name='tempest-keypair-983611867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02c6280808c74bc29546ad4380d18c00',ramdisk_id='',reservation_id='r-lypcgltu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1278929434',owner_user_name='tempest-VolumesSnapshotTestJSON-1278929434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b426e1ce287140808e69375cb864c8c1',uuid=aaedeacc-86d7-4fae-8157-e3b142856138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converting VIF {"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'pci_devices' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:53:09 user nova-compute[74075]:   <uuid>aaedeacc-86d7-4fae-8157-e3b142856138</uuid>
Oct 26 09:53:09 user nova-compute[74075]:   <name>instance-00000029</name>
Oct 26 09:53:09 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:53:09 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:53:09 user nova-compute[74075]:   <metadata>
Oct 26 09:53:09 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:53:09 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:53:09 user nova-compute[74075]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1616911063</nova:name>
Oct 26 09:53:09 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:53:09</nova:creationTime>
Oct 26 09:53:09 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:53:09 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:53:09 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:53:09 user nova-compute[74075]:       <nova:owner>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:user uuid="b426e1ce287140808e69375cb864c8c1">tempest-VolumesSnapshotTestJSON-1278929434-project-member</nova:user>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:project uuid="02c6280808c74bc29546ad4380d18c00">tempest-VolumesSnapshotTestJSON-1278929434</nova:project>
Oct 26 09:53:09 user nova-compute[74075]:       </nova:owner>
Oct 26 09:53:09 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:53:09 user nova-compute[74075]:       <nova:ports>
Oct 26 09:53:09 user nova-compute[74075]:         <nova:port uuid="891fd05d-ab72-4447-87d8-227dd45f905a">
Oct 26 09:53:09 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 09:53:09 user nova-compute[74075]:         </nova:port>
Oct 26 09:53:09 user nova-compute[74075]:       </nova:ports>
Oct 26 09:53:09 user nova-compute[74075]:     </nova:instance>
Oct 26 09:53:09 user nova-compute[74075]:   </metadata>
Oct 26 09:53:09 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:53:09 user nova-compute[74075]:     <system>
Oct 26 09:53:09 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:53:09 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:53:09 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:53:09 user nova-compute[74075]:       <entry name="serial">aaedeacc-86d7-4fae-8157-e3b142856138</entry>
Oct 26 09:53:09 user nova-compute[74075]:       <entry name="uuid">aaedeacc-86d7-4fae-8157-e3b142856138</entry>
Oct 26 09:53:09 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:53:09 user nova-compute[74075]:     </system>
Oct 26 09:53:09 user nova-compute[74075]:   </sysinfo>
Oct 26 09:53:09 user nova-compute[74075]:   <os>
Oct 26 09:53:09 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:53:09 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:53:09 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:53:09 user nova-compute[74075]:   </os>
Oct 26 09:53:09 user nova-compute[74075]:   <features>
Oct 26 09:53:09 user nova-compute[74075]:     <acpi/>
Oct 26 09:53:09 user nova-compute[74075]:     <apic/>
Oct 26 09:53:09 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:53:09 user nova-compute[74075]:   </features>
Oct 26 09:53:09 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:53:09 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:53:09 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:53:09 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:53:09 user nova-compute[74075]:   </clock>
Oct 26 09:53:09 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:53:09 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:53:09 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:53:09 user nova-compute[74075]:   </cpu>
Oct 26 09:53:09 user nova-compute[74075]:   <devices>
Oct 26 09:53:09 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:53:09 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:53:09 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk"/>
Oct 26 09:53:09 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:53:09 user nova-compute[74075]:     </disk>
Oct 26 09:53:09 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:53:09 user nova-compute[74075]:       <mac address="fa:16:3e:fd:39:0f"/>
Oct 26 09:53:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:53:09 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:53:09 user nova-compute[74075]:       <target dev="tap891fd05d-ab"/>
Oct 26 09:53:09 user nova-compute[74075]:     </interface>
Oct 26 09:53:09 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:53:09 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/console.log" append="off"/>
Oct 26 09:53:09 user nova-compute[74075]:     </serial>
Oct 26 09:53:09 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:53:09 user nova-compute[74075]:     <video>
Oct 26 09:53:09 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:53:09 user nova-compute[74075]:     </video>
Oct 26 09:53:09 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:53:09 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:53:09 user nova-compute[74075]:     </rng>
Oct 26 09:53:09 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:53:09 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:53:09 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:53:09 user nova-compute[74075]:     </memballoon>
Oct 26 09:53:09 user nova-compute[74075]:   </devices>
Oct 26 09:53:09 user nova-compute[74075]: </domain>
Oct 26 09:53:09 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1616911063',display_name='tempest-VolumesSnapshotTestJSON-instance-1616911063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1616911063',id=41,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc/XvEBz76ESXxVPsBRR2ODgkrgo6XgumaZBcwD21g+guIAyszzlJhdJj1UFO5cSqy04WXJtVRw/kNCRz53j/mFuV7ysT5jQxI+EuKxagovzYSSJUc6+po5KlMub9T9nQ==',key_name='tempest-keypair-983611867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02c6280808c74bc29546ad4380d18c00',ramdisk_id='',reservation_id='r-lypcgltu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1278929434',owner_user_name='tempest-VolumesSnapshotTestJSON-1278929434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b426e1ce287140808e69375cb864c8c1',uuid=aaedeacc-86d7-4fae-8157-e3b142856138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converting VIF {"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG os_vif [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85b7160b-7b9d-5ea3-8107-0081c971ecd3', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap891fd05d-ab, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap891fd05d-ab, col_values=(('qos', UUID('575d8d49-e448-4830-bcbf-ca6ce64d46ae')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap891fd05d-ab, col_values=(('external_ids', {'iface-id': '891fd05d-ab72-4447-87d8-227dd45f905a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:39:0f', 'vm-uuid': 'aaedeacc-86d7-4fae-8157-e3b142856138'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:09 user nova-compute[74075]: INFO os_vif [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab')
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No VIF found with MAC fa:16:3e:fd:39:0f, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updated VIF entry in instance network info cache for port 891fd05d-ab72-4447-87d8-227dd45f905a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating instance_info_cache with network_info: [{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:53:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-34300a37-407b-4f81-8cb0-0eb6176bbb28 req-3cd548fa-d6da-4d10-a7a3-d3080c967b6d service nova] Releasing lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-f9deca98-cf8f-46ec-b73f-1bc4945d436c req-3f59479e-711b-483c-8a60-cb27bafec7a6 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f9deca98-cf8f-46ec-b73f-1bc4945d436c req-3f59479e-711b-483c-8a60-cb27bafec7a6 service nova] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f9deca98-cf8f-46ec-b73f-1bc4945d436c req-3f59479e-711b-483c-8a60-cb27bafec7a6 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f9deca98-cf8f-46ec-b73f-1bc4945d436c req-3f59479e-711b-483c-8a60-cb27bafec7a6 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-f9deca98-cf8f-46ec-b73f-1bc4945d436c req-3f59479e-711b-483c-8a60-cb27bafec7a6 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] No waiting events found dispatching network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:53:11 user nova-compute[74075]: WARNING nova.compute.manager [req-f9deca98-cf8f-46ec-b73f-1bc4945d436c req-3f59479e-711b-483c-8a60-cb27bafec7a6 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received unexpected event network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a for instance with vm_state building and task_state spawning.
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:11 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:53:13 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Instance spawned successfully.
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:53:13 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:53:13 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=25.33600616455078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:53:13 user nova-compute[74075]: INFO nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Took 5.85 seconds to spawn the instance on the hypervisor.
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance aaedeacc-86d7-4fae-8157-e3b142856138 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-6f68061a-08ed-4242-a567-9a2c694bb008 req-d37b9fdd-5719-4d61-871a-dd5be2158a47 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6f68061a-08ed-4242-a567-9a2c694bb008 req-d37b9fdd-5719-4d61-871a-dd5be2158a47 service nova] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6f68061a-08ed-4242-a567-9a2c694bb008 req-d37b9fdd-5719-4d61-871a-dd5be2158a47 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6f68061a-08ed-4242-a567-9a2c694bb008 req-d37b9fdd-5719-4d61-871a-dd5be2158a47 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.manager [req-6f68061a-08ed-4242-a567-9a2c694bb008 req-d37b9fdd-5719-4d61-871a-dd5be2158a47 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] No waiting events found dispatching network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:53:13 user nova-compute[74075]: WARNING nova.compute.manager [req-6f68061a-08ed-4242-a567-9a2c694bb008 req-d37b9fdd-5719-4d61-871a-dd5be2158a47 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received unexpected event network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a for instance with vm_state building and task_state spawning.
Oct 26 09:53:13 user nova-compute[74075]: INFO nova.compute.manager [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Took 6.50 seconds to build instance.
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3fc1a6e5-e5fe-492d-a941-c7c14278fc2b tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.618s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:53:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:53:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:53:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing instance network info cache due to event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updated VIF entry in instance network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:53:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-80311963-f75e-4609-8f97-68a3c0f9e423 req-1a61cb65-22d1-456b-9ee5-2c0894d0736f service nova] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:53:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:33 user nova-compute[74075]: INFO nova.compute.manager [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Shelving
Oct 26 09:53:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-08867d68-5437-44bd-99b2-86caece0f5a2 req-d02e025f-17d6-4f81-b27f-b8adefa6d482 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-unplugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-08867d68-5437-44bd-99b2-86caece0f5a2 req-d02e025f-17d6-4f81-b27f-b8adefa6d482 service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-08867d68-5437-44bd-99b2-86caece0f5a2 req-d02e025f-17d6-4f81-b27f-b8adefa6d482 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-08867d68-5437-44bd-99b2-86caece0f5a2 req-d02e025f-17d6-4f81-b27f-b8adefa6d482 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-08867d68-5437-44bd-99b2-86caece0f5a2 req-d02e025f-17d6-4f81-b27f-b8adefa6d482 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-unplugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:53:34 user nova-compute[74075]: WARNING nova.compute.manager [req-08867d68-5437-44bd-99b2-86caece0f5a2 req-d02e025f-17d6-4f81-b27f-b8adefa6d482 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-unplugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state active and task_state shelving.
Oct 26 09:53:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance destroyed successfully.
Oct 26 09:53:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Beginning cold snapshot process
Oct 26 09:53:34 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:53:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk /opt/stack/data/nova/instances/snapshots/tmpeuijdwzy/998b03fe12994f1c9c7a10c024d574b3 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:53:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk /opt/stack/data/nova/instances/snapshots/tmpeuijdwzy/998b03fe12994f1c9c7a10c024d574b3" returned: 0 in 1.044s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:53:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Snapshot extracted, beginning image upload
Oct 26 09:53:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-70489ade-31d8-4a0e-849c-bade7d3e91ff req-b8eec8ca-6bae-4a85-8b06-dec9a23b5ad2 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70489ade-31d8-4a0e-849c-bade7d3e91ff req-b8eec8ca-6bae-4a85-8b06-dec9a23b5ad2 service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70489ade-31d8-4a0e-849c-bade7d3e91ff req-b8eec8ca-6bae-4a85-8b06-dec9a23b5ad2 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70489ade-31d8-4a0e-849c-bade7d3e91ff req-b8eec8ca-6bae-4a85-8b06-dec9a23b5ad2 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-70489ade-31d8-4a0e-849c-bade7d3e91ff req-b8eec8ca-6bae-4a85-8b06-dec9a23b5ad2 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:53:36 user nova-compute[74075]: WARNING nova.compute.manager [req-70489ade-31d8-4a0e-849c-bade7d3e91ff req-b8eec8ca-6bae-4a85-8b06-dec9a23b5ad2 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 09:53:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Snapshot image upload complete
Oct 26 09:53:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:53:38 user nova-compute[74075]: INFO nova.compute.manager [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Shelve offloading
Oct 26 09:53:38 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance destroyed successfully.
Oct 26 09:53:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:53:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:53:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:53:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:53:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:53:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance destroyed successfully.
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'resources' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1236549554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1236549554',id=40,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNnvjCfvPB1KGplHt5oMdZAYISTQd1tvKOHYGMso7wgp/ChdmJeO8r+rIGvadr95UgdgvGGryEjTGo+ffw3ZzkUV1s4zvT8fMaiMy6j5xd4oFV4Z7RQCW4Hgif7AtbAw==',key_name='tempest-keypair-1782388923',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-829s1i6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member',shelved_at='2023-10-26T09:53:38.306895',shelved_host='user',shelved_image_id='81615053-539e-4c22-9fbd-290062e33d29'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=9149ef7a-dfc7-4cf8-973e-74ef910c3867,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG os_vif [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcb2810b-ea, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55c9f980-93cf-4b06-bbe4-3961023ac116) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.compute.manager [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing instance network info cache due to event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.network.neutron [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:39 user nova-compute[74075]: INFO os_vif [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea')
Oct 26 09:53:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Deleting instance files /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867_del
Oct 26 09:53:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Deletion of /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867_del complete
Oct 26 09:53:39 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Deleted allocations for instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867
Oct 26 09:53:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.objects.instance [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'numa_topology' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.objects.base [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<9149ef7a-dfc7-4cf8-973e-74ef910c3867> lazy-loaded attributes: resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:53:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-2dcc86e2-90c0-45bd-8d0b-37a660ab15de tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.466s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:53:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updated VIF entry in instance network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:53:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:53:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e7e315d5-de83-49f6-a80b-741fcc65958f req-33383f93-3da3-47a0-84a3-b027419f05eb service nova] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:53:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:53:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:53:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:53:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:53:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:53:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:09 user nova-compute[74075]: INFO nova.compute.manager [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Terminating instance
Oct 26 09:54:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-61924386-c6ab-49d0-9bda-be1584763d9b req-15ca626d-bc0f-43fb-90ce-cbd591781675 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-vif-unplugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-61924386-c6ab-49d0-9bda-be1584763d9b req-15ca626d-bc0f-43fb-90ce-cbd591781675 service nova] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-61924386-c6ab-49d0-9bda-be1584763d9b req-15ca626d-bc0f-43fb-90ce-cbd591781675 service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-61924386-c6ab-49d0-9bda-be1584763d9b req-15ca626d-bc0f-43fb-90ce-cbd591781675 service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-61924386-c6ab-49d0-9bda-be1584763d9b req-15ca626d-bc0f-43fb-90ce-cbd591781675 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] No waiting events found dispatching network-vif-unplugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:54:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-61924386-c6ab-49d0-9bda-be1584763d9b req-15ca626d-bc0f-43fb-90ce-cbd591781675 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-vif-unplugged-87db5054-6998-4feb-92a9-ce407ec5728e for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:10 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Instance destroyed successfully.
Oct 26 09:54:10 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lazy-loading 'resources' on Instance uuid 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:44:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1440831571',display_name='tempest-SnapshotDataIntegrityTests-server-1440831571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1440831571',id=36,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgAbyD2HugliqyG53yNz4GMSBuWTvc3QbOBCugV2khENHBCXRD6+WILMPoypDpeT3TLOMKCUVB45KV/IgzP8GCvylpf/SfiiU3jQe6nsQ1wy7mNSdKc4ZLl/xDchHWbtQ==',key_name='tempest-keypair-769290502',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bd1bed154a45eeb68f065f7222870d',ramdisk_id='',reservation_id='r-wyx1z3j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-599902097',owner_user_name='tempest-SnapshotDataIntegrityTests-599902097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ecad0daaf5f4013a82174a02c2a1213',uuid=4b80a751-1c08-48c8-a2f4-e6c9ff01d479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Converting VIF {"id": "87db5054-6998-4feb-92a9-ce407ec5728e", "address": "fa:16:3e:7b:13:18", "network": {"id": "182a2f01-fe82-4a91-9c5f-0f0164d36989", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-40755246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bd1bed154a45eeb68f065f7222870d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87db5054-69", "ovs_interfaceid": "87db5054-6998-4feb-92a9-ce407ec5728e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG os_vif [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87db5054-69, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1db1d1ba-ee39-40c4-9ea5-1b8fc6f647e4) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:10 user nova-compute[74075]: INFO os_vif [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:13:18,bridge_name='br-int',has_traffic_filtering=True,id=87db5054-6998-4feb-92a9-ce407ec5728e,network=Network(182a2f01-fe82-4a91-9c5f-0f0164d36989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87db5054-69')
Oct 26 09:54:10 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Deleting instance files /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479_del
Oct 26 09:54:10 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Deletion of /opt/stack/data/nova/instances/4b80a751-1c08-48c8-a2f4-e6c9ff01d479_del complete
Oct 26 09:54:10 user nova-compute[74075]: INFO nova.compute.manager [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 09:54:10 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:54:10 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:54:11 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Took 0.80 seconds to deallocate network for instance.
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-a150ab68-8f99-4772-aa14-83f75b00b265 req-b680617d-9a49-4ec6-affd-47c029c7fc72 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-vif-deleted-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:54:11 user nova-compute[74075]: INFO nova.compute.manager [req-a150ab68-8f99-4772-aa14-83f75b00b265 req-b680617d-9a49-4ec6-affd-47c029c7fc72 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Neutron deleted interface 87db5054-6998-4feb-92a9-ce407ec5728e; detaching it from the instance and deleting it from the info cache
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.network.neutron [req-a150ab68-8f99-4772-aa14-83f75b00b265 req-b680617d-9a49-4ec6-affd-47c029c7fc72 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-a150ab68-8f99-4772-aa14-83f75b00b265 req-b680617d-9a49-4ec6-affd-47c029c7fc72 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Detach interface failed, port_id=87db5054-6998-4feb-92a9-ce407ec5728e, reason: Instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:11 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Deleted allocations for instance 4b80a751-1c08-48c8-a2f4-e6c9ff01d479
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e2e6120e-84ca-4de5-a05b-3ef2174b4a82 tempest-SnapshotDataIntegrityTests-599902097 tempest-SnapshotDataIntegrityTests-599902097-project-member] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-5c8b0cd2-dba1-4544-8639-951fd25ad008 req-4167c8d8-5231-4e5c-8e78-6212131be030 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received event network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5c8b0cd2-dba1-4544-8639-951fd25ad008 req-4167c8d8-5231-4e5c-8e78-6212131be030 service nova] Acquiring lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5c8b0cd2-dba1-4544-8639-951fd25ad008 req-4167c8d8-5231-4e5c-8e78-6212131be030 service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5c8b0cd2-dba1-4544-8639-951fd25ad008 req-4167c8d8-5231-4e5c-8e78-6212131be030 service nova] Lock "4b80a751-1c08-48c8-a2f4-e6c9ff01d479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:11 user nova-compute[74075]: DEBUG nova.compute.manager [req-5c8b0cd2-dba1-4544-8639-951fd25ad008 req-4167c8d8-5231-4e5c-8e78-6212131be030 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] No waiting events found dispatching network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:54:11 user nova-compute[74075]: WARNING nova.compute.manager [req-5c8b0cd2-dba1-4544-8639-951fd25ad008 req-4167c8d8-5231-4e5c-8e78-6212131be030 service nova] [instance: 4b80a751-1c08-48c8-a2f4-e6c9ff01d479] Received unexpected event network-vif-plugged-87db5054-6998-4feb-92a9-ce407ec5728e for instance with vm_state deleted and task_state None.
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:54:13 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:54:13 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.30294418334961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance aaedeacc-86d7-4fae-8157-e3b142856138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:54:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating instance_info_cache with network_info: [{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:54:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:54:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:54:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:54:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:54:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:54:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:54:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-changed-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:54:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Refreshing instance network info cache due to event network-changed-891fd05d-ab72-4447-87d8-227dd45f905a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:54:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] Acquiring lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:54:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] Acquired lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:54:57 user nova-compute[74075]: DEBUG nova.network.neutron [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Refreshing network info cache for port 891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:54:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'flavor' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:54:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Ignoring supplied device name: /dev/vdb
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:54:58 user nova-compute[74075]: INFO nova.compute.manager [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Attaching volume 1938a9f1-1731-4dc9-b400-89c9003a4492 to /dev/vdb
Oct 26 09:54:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b6d38-41c5-4fec-ad63-9ed3aacd68ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[87496b13-1378-4cdd-a081-62955a16d6b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2a48e-0328-4e0c-aea3-53a3c6e84298]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a397e64-e1a5-47b6-b040-9f068f43fef7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:54:58 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d8e5c-4845-4a66-8f68-1b50357f13b1]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG os_brick.utils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating existing volume attachment record: 9f9821cf-15f2-4cc6-b525-4fb4086ff372 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG nova.network.neutron [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updated VIF entry in instance network info cache for port 891fd05d-ab72-4447-87d8-227dd45f905a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG nova.network.neutron [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating instance_info_cache with network_info: [{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:54:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ba7ec54-5ef2-4167-9013-5633e0d7a0c4 req-83230fcc-778e-4ce8-a00c-d3fdcace6254 service nova] Releasing lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:55:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:12 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:12 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 09:55:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:14 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:55:14 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.299697875976562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance aaedeacc-86d7-4fae-8157-e3b142856138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:55:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:55:16 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiOtcDXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:55:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:55:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:55:17 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb7e84-cd4f-47f3-8cee-a2e7988d2473]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:55:17 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e222cb43-356d-443a-b430-22866a69aa35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492] added
Oct 26 09:55:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating instance_info_cache with network_info: [{"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a356a4a-5fa5-4285-af04-385eee982424]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-aaedeacc-86d7-4fae-8157-e3b142856138" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b747980-7f5a-448b-9cf4-ca3f5c162b1f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiOtcDXE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiOtcDXE" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f258ce1-3e7b-44ea-b793-c9ec9c8659b9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fiOtcDXE'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[050466af-d641-49e0-8034-d3e4bb05688d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0183a6e1-3009-4365-b656-9e0525cfc3dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:55:17 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:55:17 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:55:17 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 09:55:17 user nova-compute[74075]: 
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8e9ad-9b91-45a9-a0cb-d79febb9a76a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260]
Oct 26 09:55:17 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260] successful.
Oct 26 09:55:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553cadb-7190-40a4-9570-f5b675e27437]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e663db36-75ac-47e8-bee0-7486c36ef879]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:55:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:55:17 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a53870-ee73-4434-844a-798a793f5e3f]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:55:17 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiOtcDXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26463343739373261', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463343739373261', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG nova.objects.instance [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'flavor' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 09:55:18 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:55:18 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:55:18 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:55:18 user nova-compute[74075]:   <serial>1938a9f1-1731-4dc9-b400-89c9003a4492</serial>
Oct 26 09:55:18 user nova-compute[74075]: </disk>
Oct 26 09:55:18 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] No VIF found with MAC fa:16:3e:fd:39:0f, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:55:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-586fae6d-c5a3-4e80-8b48-fd9b3adee1c7 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.594s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:55:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:55:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:25 user nova-compute[74075]: INFO nova.compute.manager [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Unshelving
Oct 26 09:55:25 user nova-compute[74075]: INFO nova.virt.block_device [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Booting with volume 4d4d3f98-6908-42c3-b105-1a636c7924ca at /dev/vdc
Oct 26 09:55:25 user nova-compute[74075]: DEBUG os_brick.utils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:55:25 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f89009-613f-4798-9fc0-ca83274743f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b084a1f-1190-4f57-a333-12a8e1c2c9ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[41deaf03-7b2f-41d3-8bfe-c014d62ea490]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[024ee32f-2c28-4941-bbbc-62e84f62399d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:55:26 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc95d56-0503-45c8-b2cb-6e17b2f4f995]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG os_brick.utils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating existing volume attachment record: d173d35c-a9fe-476a-8964-cc475b7579b6 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:55:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:55:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:55:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 09:55:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 09:55:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'pci_requests' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'numa_topology' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:55:44 user nova-compute[74075]: INFO nova.compute.claims [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Claim successful on node user
Oct 26 09:55:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:55:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:44 user nova-compute[74075]: INFO nova.network.neutron [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating port fcb2810b-ead9-4019-9312-a77cc0d060c9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing instance network info cache due to event network-changed-fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:55:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Creating image(s)
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.network.neutron [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Refreshing network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG nova.objects.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<9149ef7a-dfc7-4cf8-973e-74ef910c3867> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "965c5b03675fbf5d6d983a8df738d875cbe06c6c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "965c5b03675fbf5d6d983a8df738d875cbe06c6c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG nova.virt.images [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] 81615053-539e-4c22-9fbd-290062e33d29 was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.part /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updated VIF entry in instance network info cache for port fcb2810b-ead9-4019-9312-a77cc0d060c9. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:55:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1c4a1aab-c20f-4a5a-a956-7b3ccda97df7 req-0c35b757-89af-4b38-a05c-65bf713e984c service nova] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.part /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.converted" returned: 0 in 0.529s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "965c5b03675fbf5d6d983a8df738d875cbe06c6c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.814s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "965c5b03675fbf5d6d983a8df738d875cbe06c6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "965c5b03675fbf5d6d983a8df738d875cbe06c6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c,backing_fmt=raw /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c,backing_fmt=raw /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk 1073741824" returned: 0 in 0.047s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "965c5b03675fbf5d6d983a8df738d875cbe06c6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:47 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:48 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'migration_context' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:48 user nova-compute[74075]: DEBUG nova.objects.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<9149ef7a-dfc7-4cf8-973e-74ef910c3867> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:55:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Rebasing disk image.
Oct 26 09:55:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:48 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f -F raw /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f -F raw /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk" returned: 0 in 2.277s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Ensure instance console log exists: /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Start _get_guest_xml network_info=[{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c6c12b5a275708acd2afc12fed3ba7ac',container_format='bare',created_at=2023-10-26T09:53:33Z,direct_url=<?>,disk_format='qcow2',id=81615053-539e-4c22-9fbd-290062e33d29,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1236549554-shelved',owner='9f38f50a5217486f935724fd94a0d419',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T09:53:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'd173d35c-a9fe-476a-8964-cc475b7579b6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSAaCwfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9149ef7a-dfc7-4cf8-973e-74ef910c3867', 'attached_at': '', 'detached_at': '', 'volume_id': '4d4d3f98-6908-42c3-b105-1a636c7924ca', 'serial': '4d4d3f98-6908-42c3-b105-1a636c7924ca'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:55:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:55:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c6c12b5a275708acd2afc12fed3ba7ac',container_format='bare',created_at=2023-10-26T09:53:33Z,direct_url=<?>,disk_format='qcow2',id=81615053-539e-4c22-9fbd-290062e33d29,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1236549554-shelved',owner='9f38f50a5217486f935724fd94a0d419',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T09:53:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.objects.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<9149ef7a-dfc7-4cf8-973e-74ef910c3867> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSAaCwfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:55:50 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:55:50 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:55:50 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66371ed3-522e-4d3b-9330-f04d05c68def]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:55:50 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc56150-0b42-44df-8d2a-5f47ee3972d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca] added
Oct 26 09:55:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5683d9f7-5a62-4358-9081-3b22a3471b8c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1078de0f-db83-4186-9f42-7b2e2f8ba8e5]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSAaCwfZ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSAaCwfZ" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca9a4d-6a3d-437c-b560-43487d4c8618]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSAaCwfZ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a9f4a0-070b-4a4d-a4fb-b93f2bab244c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465a5a2-5ab4-4f98-90d1-4d04c6d8da0b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:55:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:55:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d636c-90b2-46e9-af93-9e5d5ddc2b6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260]
Oct 26 09:55:50 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260] successful.
Oct 26 09:55:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[703fbafc-1c33-4f51-9d02-1682e0321a3a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a93888-c66e-4454-8e15-6970761b83e8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:55:50 user nova-compute[74075]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:55:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:55:50 user nova-compute[74075]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:55:50 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:55:50 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:55:51 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:55:51 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[266e9b2c-633b-4900-9529-2073f1880bcf]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:55:51 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSAaCwfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23833643563623165', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833643563623165', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1236549554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1236549554',id=40,image_ref='81615053-539e-4c22-9fbd-290062e33d29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1782388923',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-829s1i6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member',shelved_at='2023-10-26T09:53:38.306895',shelved_host='user',shelved_image_id='81615053-539e-4c22-9fbd-290062e33d29'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=9149ef7a-dfc7-4cf8-973e-74ef910c3867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'pci_devices' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.objects.base [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<9149ef7a-dfc7-4cf8-973e-74ef910c3867> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:55:52 user nova-compute[74075]:   <uuid>9149ef7a-dfc7-4cf8-973e-74ef910c3867</uuid>
Oct 26 09:55:52 user nova-compute[74075]:   <name>instance-00000028</name>
Oct 26 09:55:52 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:55:52 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:55:52 user nova-compute[74075]:   <metadata>
Oct 26 09:55:52 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:55:52 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:55:52 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1236549554</nova:name>
Oct 26 09:55:52 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:55:50</nova:creationTime>
Oct 26 09:55:52 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:55:52 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:55:52 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:55:52 user nova-compute[74075]:       <nova:owner>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:user uuid="1c88b9df9bbd4d09adc2e1846fae72b2">tempest-AttachVolumeShelveTestJSON-85318806-project-member</nova:user>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:project uuid="9f38f50a5217486f935724fd94a0d419">tempest-AttachVolumeShelveTestJSON-85318806</nova:project>
Oct 26 09:55:52 user nova-compute[74075]:       </nova:owner>
Oct 26 09:55:52 user nova-compute[74075]:       <nova:root type="image" uuid="81615053-539e-4c22-9fbd-290062e33d29"/>
Oct 26 09:55:52 user nova-compute[74075]:       <nova:ports>
Oct 26 09:55:52 user nova-compute[74075]:         <nova:port uuid="fcb2810b-ead9-4019-9312-a77cc0d060c9">
Oct 26 09:55:52 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 09:55:52 user nova-compute[74075]:         </nova:port>
Oct 26 09:55:52 user nova-compute[74075]:       </nova:ports>
Oct 26 09:55:52 user nova-compute[74075]:     </nova:instance>
Oct 26 09:55:52 user nova-compute[74075]:   </metadata>
Oct 26 09:55:52 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:55:52 user nova-compute[74075]:     <system>
Oct 26 09:55:52 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:55:52 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:55:52 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:55:52 user nova-compute[74075]:       <entry name="serial">9149ef7a-dfc7-4cf8-973e-74ef910c3867</entry>
Oct 26 09:55:52 user nova-compute[74075]:       <entry name="uuid">9149ef7a-dfc7-4cf8-973e-74ef910c3867</entry>
Oct 26 09:55:52 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:55:52 user nova-compute[74075]:     </system>
Oct 26 09:55:52 user nova-compute[74075]:   </sysinfo>
Oct 26 09:55:52 user nova-compute[74075]:   <os>
Oct 26 09:55:52 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:55:52 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:55:52 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:55:52 user nova-compute[74075]:   </os>
Oct 26 09:55:52 user nova-compute[74075]:   <features>
Oct 26 09:55:52 user nova-compute[74075]:     <acpi/>
Oct 26 09:55:52 user nova-compute[74075]:     <apic/>
Oct 26 09:55:52 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:55:52 user nova-compute[74075]:   </features>
Oct 26 09:55:52 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:55:52 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:55:52 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:55:52 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:55:52 user nova-compute[74075]:   </clock>
Oct 26 09:55:52 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:55:52 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:55:52 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:55:52 user nova-compute[74075]:   </cpu>
Oct 26 09:55:52 user nova-compute[74075]:   <devices>
Oct 26 09:55:52 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:55:52 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:55:52 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk"/>
Oct 26 09:55:52 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:55:52 user nova-compute[74075]:     </disk>
Oct 26 09:55:52 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:55:52 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:55:52 user nova-compute[74075]:       <source dev="/dev/sdc"/>
Oct 26 09:55:52 user nova-compute[74075]:       <target dev="vdc" bus="virtio"/>
Oct 26 09:55:52 user nova-compute[74075]:       <serial>4d4d3f98-6908-42c3-b105-1a636c7924ca</serial>
Oct 26 09:55:52 user nova-compute[74075]:     </disk>
Oct 26 09:55:52 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:55:52 user nova-compute[74075]:       <mac address="fa:16:3e:f6:d5:94"/>
Oct 26 09:55:52 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:55:52 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:55:52 user nova-compute[74075]:       <target dev="tapfcb2810b-ea"/>
Oct 26 09:55:52 user nova-compute[74075]:     </interface>
Oct 26 09:55:52 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:55:52 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/console.log" append="off"/>
Oct 26 09:55:52 user nova-compute[74075]:     </serial>
Oct 26 09:55:52 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:55:52 user nova-compute[74075]:     <video>
Oct 26 09:55:52 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:55:52 user nova-compute[74075]:     </video>
Oct 26 09:55:52 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:55:52 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:55:52 user nova-compute[74075]:     </rng>
Oct 26 09:55:52 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:55:52 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:55:52 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:55:52 user nova-compute[74075]:     </memballoon>
Oct 26 09:55:52 user nova-compute[74075]:   </devices>
Oct 26 09:55:52 user nova-compute[74075]: </domain>
Oct 26 09:55:52 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1236549554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1236549554',id=40,image_ref='81615053-539e-4c22-9fbd-290062e33d29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1782388923',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-829s1i6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member',shelved_at='2023-10-26T09:53:38.306895',shelved_host='user',shelved_image_id='81615053-539e-4c22-9fbd-290062e33d29'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=9149ef7a-dfc7-4cf8-973e-74ef910c3867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG os_vif [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '271c7322-2e3b-56bf-b41a-7a0643fe1e66', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcb2810b-ea, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcb2810b-ea, col_values=(('qos', UUID('cc7fe558-ff07-47e7-b3f0-88e758fe11c4')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcb2810b-ea, col_values=(('external_ids', {'iface-id': 'fcb2810b-ead9-4019-9312-a77cc0d060c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:d5:94', 'vm-uuid': '9149ef7a-dfc7-4cf8-973e-74ef910c3867'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:52 user nova-compute[74075]: INFO os_vif [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea')
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:55:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No VIF found with MAC fa:16:3e:f6:d5:94, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-23833a29-49c4-4d0e-9066-342e9a9c8f4e req-a67b5c73-8d63-4e3b-b828-6da41ade15bd service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-23833a29-49c4-4d0e-9066-342e9a9c8f4e req-a67b5c73-8d63-4e3b-b828-6da41ade15bd service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-23833a29-49c4-4d0e-9066-342e9a9c8f4e req-a67b5c73-8d63-4e3b-b828-6da41ade15bd service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-23833a29-49c4-4d0e-9066-342e9a9c8f4e req-a67b5c73-8d63-4e3b-b828-6da41ade15bd service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-23833a29-49c4-4d0e-9066-342e9a9c8f4e req-a67b5c73-8d63-4e3b-b828-6da41ade15bd service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:55:53 user nova-compute[74075]: WARNING nova.compute.manager [req-23833a29-49c4-4d0e-9066-342e9a9c8f4e req-a67b5c73-8d63-4e3b-b828-6da41ade15bd service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 09:55:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:55:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance spawned successfully.
Oct 26 09:55:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-c6269dd8-68d3-4ed5-a5be-97c002ad209a req-341a2c49-af2b-4010-9448-78038bcc50f4 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c6269dd8-68d3-4ed5-a5be-97c002ad209a req-341a2c49-af2b-4010-9448-78038bcc50f4 service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c6269dd8-68d3-4ed5-a5be-97c002ad209a req-341a2c49-af2b-4010-9448-78038bcc50f4 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c6269dd8-68d3-4ed5-a5be-97c002ad209a req-341a2c49-af2b-4010-9448-78038bcc50f4 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-c6269dd8-68d3-4ed5-a5be-97c002ad209a req-341a2c49-af2b-4010-9448-78038bcc50f4 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:55:55 user nova-compute[74075]: WARNING nova.compute.manager [req-c6269dd8-68d3-4ed5-a5be-97c002ad209a req-341a2c49-af2b-4010-9448-78038bcc50f4 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 09:55:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:55:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6abf7a51-dd7f-462f-bc24-2f01f099997a tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.107s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:55:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:55:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:10 user nova-compute[74075]: INFO nova.compute.manager [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Detaching volume 1938a9f1-1731-4dc9-b400-89c9003a4492
Oct 26 09:56:10 user nova-compute[74075]: INFO nova.virt.block_device [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Attempting to driver detach volume 1938a9f1-1731-4dc9-b400-89c9003a4492 from mountpoint /dev/vdb
Oct 26 09:56:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Attempting to detach device vdb from instance aaedeacc-86d7-4fae-8157-e3b142856138 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:56:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:56:10 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:56:10 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:56:10 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:56:10 user nova-compute[74075]:   <serial>1938a9f1-1731-4dc9-b400-89c9003a4492</serial>
Oct 26 09:56:10 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:56:10 user nova-compute[74075]: </disk>
Oct 26 09:56:10 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:56:10 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully detached device vdb from instance aaedeacc-86d7-4fae-8157-e3b142856138 from the persistent domain config.
Oct 26 09:56:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aaedeacc-86d7-4fae-8157-e3b142856138 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:56:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:56:10 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:56:10 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 09:56:10 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 09:56:10 user nova-compute[74075]:   <serial>1938a9f1-1731-4dc9-b400-89c9003a4492</serial>
Oct 26 09:56:10 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 09:56:10 user nova-compute[74075]: </disk>
Oct 26 09:56:10 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:56:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:10 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:56:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:14 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:56:15 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.26470184326172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance aaedeacc-86d7-4fae-8157-e3b142856138 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:56:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Skipping network cache update for instance because it is being deleted. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:56:16 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:56:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:56:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:30 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aaedeacc-86d7-4fae-8157-e3b142856138 is timed out.
Oct 26 09:56:30 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully detached device vdb from instance aaedeacc-86d7-4fae-8157-e3b142856138 from the live domain config.
Oct 26 09:56:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiOtcDXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:56:30 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[033fe657-99d7-4000-9c13-0af8b77fc4d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:56:30 user nova-compute[74075]: No targets found.
Oct 26 09:56:30 user nova-compute[74075]: iSNS:
Oct 26 09:56:30 user nova-compute[74075]: No targets found.
Oct 26 09:56:30 user nova-compute[74075]: STATIC:
Oct 26 09:56:30 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492
Oct 26 09:56:30 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:56:30 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:56:30 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca
Oct 26 09:56:30 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:56:30 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:56:30 user nova-compute[74075]: FIRMWARE:
Oct 26 09:56:30 user nova-compute[74075]: No targets found.
Oct 26 09:56:30 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:56:30 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:56:30 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f5a753-1d39-4d19-b887-72179588d41e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b18947-1b27-4bea-8e05-fa373847202f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:56:30 user nova-compute[74075]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:56:30 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 (non-flash)
Oct 26 09:56:30 user nova-compute[74075]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:56:30 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c16e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472fb62-3289-4667-9cc8-92c77b5f1894]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81a20c-84b4-4160-a763-f0427a38a0e3]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd5b69-b847-4e75-bb60-756d126ce992]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e483e538-1058-4da2-b17f-44afbb3942f2]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db2614d-a0a9-4e11-b197-8cce16da8837]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7061124d-bdac-426e-b46b-7e03f20684cc]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260]
Oct 26 09:56:30 user nova-compute[74075]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492, portal: 172.16.0.220,3260] successful.
Oct 26 09:56:30 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:56:30 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e352c-8dfb-4d0c-a4e5-88cf3eccc55f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== disconnect_volume: return (279ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG nova.objects.instance [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'flavor' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-260e13c9-8a2e-4852-88b1-304108850790 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.611s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:31 user nova-compute[74075]: INFO nova.compute.manager [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Terminating instance
Oct 26 09:56:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc4e1fd1-5e85-4851-a082-d9b55d291ae4 req-5b1a4deb-30df-417f-9aa6-bb54e8ef8e83 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-vif-unplugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc4e1fd1-5e85-4851-a082-d9b55d291ae4 req-5b1a4deb-30df-417f-9aa6-bb54e8ef8e83 service nova] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc4e1fd1-5e85-4851-a082-d9b55d291ae4 req-5b1a4deb-30df-417f-9aa6-bb54e8ef8e83 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-cc4e1fd1-5e85-4851-a082-d9b55d291ae4 req-5b1a4deb-30df-417f-9aa6-bb54e8ef8e83 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc4e1fd1-5e85-4851-a082-d9b55d291ae4 req-5b1a4deb-30df-417f-9aa6-bb54e8ef8e83 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] No waiting events found dispatching network-vif-unplugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-cc4e1fd1-5e85-4851-a082-d9b55d291ae4 req-5b1a4deb-30df-417f-9aa6-bb54e8ef8e83 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-vif-unplugged-891fd05d-ab72-4447-87d8-227dd45f905a for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Instance destroyed successfully.
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.objects.instance [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lazy-loading 'resources' on Instance uuid aaedeacc-86d7-4fae-8157-e3b142856138 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1616911063',display_name='tempest-VolumesSnapshotTestJSON-instance-1616911063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1616911063',id=41,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc/XvEBz76ESXxVPsBRR2ODgkrgo6XgumaZBcwD21g+guIAyszzlJhdJj1UFO5cSqy04WXJtVRw/kNCRz53j/mFuV7ysT5jQxI+EuKxagovzYSSJUc6+po5KlMub9T9nQ==',key_name='tempest-keypair-983611867',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02c6280808c74bc29546ad4380d18c00',ramdisk_id='',reservation_id='r-lypcgltu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1278929434',owner_user_name='tempest-VolumesSnapshotTestJSON-1278929434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b426e1ce287140808e69375cb864c8c1',uuid=aaedeacc-86d7-4fae-8157-e3b142856138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converting VIF {"id": "891fd05d-ab72-4447-87d8-227dd45f905a", "address": "fa:16:3e:fd:39:0f", "network": {"id": "f753d5d3-7c65-4b9d-b4d3-f0ec41892b09", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1106027444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02c6280808c74bc29546ad4380d18c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891fd05d-ab", "ovs_interfaceid": "891fd05d-ab72-4447-87d8-227dd45f905a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_vif [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap891fd05d-ab, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=575d8d49-e448-4830-bcbf-ca6ce64d46ae) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:32 user nova-compute[74075]: INFO os_vif [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=891fd05d-ab72-4447-87d8-227dd45f905a,network=Network(f753d5d3-7c65-4b9d-b4d3-f0ec41892b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891fd05d-ab')
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiOtcDXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:56:32 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6150d4dc-51de-4ee0-aaba-5ac8399d0934]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:56:32 user nova-compute[74075]: No targets found.
Oct 26 09:56:32 user nova-compute[74075]: iSNS:
Oct 26 09:56:32 user nova-compute[74075]: No targets found.
Oct 26 09:56:32 user nova-compute[74075]: STATIC:
Oct 26 09:56:32 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca
Oct 26 09:56:32 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:56:32 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:56:32 user nova-compute[74075]: FIRMWARE:
Oct 26 09:56:32 user nova-compute[74075]: No targets found.
Oct 26 09:56:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:56:32 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:56:32 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1938a9f1-1731-4dc9-b400-89c9003a4492', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ed69d-b908-4203-a553-e9deb406e2f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60882b7-fee7-4928-964b-e3b5150b513c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:56:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:56:32 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c798430>, {}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Disconnecting from: [] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] <== disconnect_volume: return (68ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:56:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Deleting instance files /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138_del
Oct 26 09:56:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Deletion of /opt/stack/data/nova/instances/aaedeacc-86d7-4fae-8157-e3b142856138_del complete
Oct 26 09:56:32 user nova-compute[74075]: INFO nova.compute.manager [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 26 09:56:32 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:56:32 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:56:33 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:56:33 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Took 0.80 seconds to deallocate network for instance.
Oct 26 09:56:33 user nova-compute[74075]: WARNING nova.volume.cinder [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Attachment 9f9821cf-15f2-4cc6-b525-4fb4086ff372 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9f9821cf-15f2-4cc6-b525-4fb4086ff372. (HTTP 404) (Request-ID: req-0b92fe90-8128-49f6-a598-314be60ee99f)
Oct 26 09:56:33 user nova-compute[74075]: INFO nova.compute.manager [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Took 0.02 seconds to detach 1 volumes for instance.
Oct 26 09:56:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-e4555d55-206b-42d7-af78-1174eea9f0a2 req-25cddcce-8e02-4ac2-b938-cd4105be9e49 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-vif-deleted-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:56:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:33 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:56:33 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:56:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:33 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Deleted allocations for instance aaedeacc-86d7-4fae-8157-e3b142856138
Oct 26 09:56:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-75f8329a-5b24-4553-b3c3-6f0f86ff0739 tempest-VolumesSnapshotTestJSON-1278929434 tempest-VolumesSnapshotTestJSON-1278929434-project-member] Lock "aaedeacc-86d7-4fae-8157-e3b142856138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb13295d-977e-4510-8f89-2665845f478c req-e7870f6f-c308-4361-9ab7-5b49a501c350 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received event network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:56:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb13295d-977e-4510-8f89-2665845f478c req-e7870f6f-c308-4361-9ab7-5b49a501c350 service nova] Acquiring lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:56:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb13295d-977e-4510-8f89-2665845f478c req-e7870f6f-c308-4361-9ab7-5b49a501c350 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:56:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-eb13295d-977e-4510-8f89-2665845f478c req-e7870f6f-c308-4361-9ab7-5b49a501c350 service nova] Lock "aaedeacc-86d7-4fae-8157-e3b142856138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:56:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-eb13295d-977e-4510-8f89-2665845f478c req-e7870f6f-c308-4361-9ab7-5b49a501c350 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] No waiting events found dispatching network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:56:34 user nova-compute[74075]: WARNING nova.compute.manager [req-eb13295d-977e-4510-8f89-2665845f478c req-e7870f6f-c308-4361-9ab7-5b49a501c350 service nova] [instance: aaedeacc-86d7-4fae-8157-e3b142856138] Received unexpected event network-vif-plugged-891fd05d-ab72-4447-87d8-227dd45f905a for instance with vm_state deleted and task_state None.
Oct 26 09:56:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:56:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:56:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:56:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:56:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:56:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:56:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:57:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:57:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:57:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:57:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [{"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-9149ef7a-dfc7-4cf8-973e-74ef910c3867" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:57:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:57:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:57:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:57:16 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.29131317138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:57:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:57:16 user nova-compute[74075]: INFO nova.compute.manager [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Detaching volume 4d4d3f98-6908-42c3-b105-1a636c7924ca
Oct 26 09:57:17 user nova-compute[74075]: INFO nova.virt.block_device [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Attempting to driver detach volume 4d4d3f98-6908-42c3-b105-1a636c7924ca from mountpoint /dev/vdc
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Attempting to detach device vdc from instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:57:17 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:57:17 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:57:17 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:57:17 user nova-compute[74075]:   <serial>4d4d3f98-6908-42c3-b105-1a636c7924ca</serial>
Oct 26 09:57:17 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 09:57:17 user nova-compute[74075]: </disk>
Oct 26 09:57:17 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:57:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully detached device vdc from instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 from the persistent domain config.
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 09:57:17 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:57:17 user nova-compute[74075]:   <source dev="/dev/sdc"/>
Oct 26 09:57:17 user nova-compute[74075]:   <target dev="vdc" bus="virtio"/>
Oct 26 09:57:17 user nova-compute[74075]:   <serial>4d4d3f98-6908-42c3-b105-1a636c7924ca</serial>
Oct 26 09:57:17 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 09:57:17 user nova-compute[74075]: </disk>
Oct 26 09:57:17 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:57:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:57:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:57:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:57:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:57:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:57:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:57:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:37 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 is timed out.
Oct 26 09:57:37 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully detached device vdc from instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 from the live domain config.
Oct 26 09:57:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSAaCwfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:57:37 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3587898d-1a7b-49d7-9515-a6ec2815ec9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 09:57:37 user nova-compute[74075]: No targets found.
Oct 26 09:57:37 user nova-compute[74075]: iSNS:
Oct 26 09:57:37 user nova-compute[74075]: No targets found.
Oct 26 09:57:37 user nova-compute[74075]: STATIC:
Oct 26 09:57:37 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca
Oct 26 09:57:37 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 09:57:37 user nova-compute[74075]:                 Iface Name: default
Oct 26 09:57:37 user nova-compute[74075]: FIRMWARE:
Oct 26 09:57:37 user nova-compute[74075]: No targets found.
Oct 26 09:57:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 09:57:37 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 09:57:37 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ded28f-b59e-4bca-a6ae-8cc10c80bcb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c64e4e-3340-48b8-be74-9b971ba5ddf0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:57:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca (non-flash)
Oct 26 09:57:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c16d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00eecd1-81b4-4301-900b-c6ee99c7a10c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19a3af-5a98-405c-96da-a495a0a7dfbe]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[295fa4d5-5285-4c3e-97a3-18a3b14cc7a6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0949aec-0909-4b09-b6bb-3787a0c8bae7]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8441f450-1cf7-456f-b97a-1cd656d56898]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[86df3306-8995-4cfe-85c5-6720c34a5958]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260]
Oct 26 09:57:37 user nova-compute[74075]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca, portal: 172.16.0.220,3260] successful.
Oct 26 09:57:37 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4d3f98-6908-42c3-b105-1a636c7924ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6d483-0d5c-477e-94dc-b790d1f64acc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] <== disconnect_volume: return (291ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:57:37 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 09:57:38 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'flavor' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:57:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ccc9926e-b7d0-4364-baeb-c41ceaa5b243 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:57:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:57:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:57:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:07 user nova-compute[74075]: INFO nova.compute.manager [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Terminating instance
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-6b743ec6-de04-4c41-bbeb-332eaa70c8d4 req-fa45dbdd-80da-429c-a0ea-c0b24edeb4a8 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-unplugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6b743ec6-de04-4c41-bbeb-332eaa70c8d4 req-fa45dbdd-80da-429c-a0ea-c0b24edeb4a8 service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6b743ec6-de04-4c41-bbeb-332eaa70c8d4 req-fa45dbdd-80da-429c-a0ea-c0b24edeb4a8 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6b743ec6-de04-4c41-bbeb-332eaa70c8d4 req-fa45dbdd-80da-429c-a0ea-c0b24edeb4a8 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-6b743ec6-de04-4c41-bbeb-332eaa70c8d4 req-fa45dbdd-80da-429c-a0ea-c0b24edeb4a8 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-unplugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-6b743ec6-de04-4c41-bbeb-332eaa70c8d4 req-fa45dbdd-80da-429c-a0ea-c0b24edeb4a8 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-unplugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Instance destroyed successfully.
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.objects.instance [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'resources' on Instance uuid 9149ef7a-dfc7-4cf8-973e-74ef910c3867 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1236549554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1236549554',id=40,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbNnvjCfvPB1KGplHt5oMdZAYISTQd1tvKOHYGMso7wgp/ChdmJeO8r+rIGvadr95UgdgvGGryEjTGo+ffw3ZzkUV1s4zvT8fMaiMy6j5xd4oFV4Z7RQCW4Hgif7AtbAw==',key_name='tempest-keypair-1782388923',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-829s1i6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=9149ef7a-dfc7-4cf8-973e-74ef910c3867,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "address": "fa:16:3e:f6:d5:94", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb2810b-ea", "ovs_interfaceid": "fcb2810b-ead9-4019-9312-a77cc0d060c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG os_vif [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcb2810b-ea, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc7fe558-ff07-47e7-b3f0-88e758fe11c4) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:07 user nova-compute[74075]: INFO os_vif [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:d5:94,bridge_name='br-int',has_traffic_filtering=True,id=fcb2810b-ead9-4019-9312-a77cc0d060c9,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb2810b-ea')
Oct 26 09:58:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Deleting instance files /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867_del
Oct 26 09:58:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Deletion of /opt/stack/data/nova/instances/9149ef7a-dfc7-4cf8-973e-74ef910c3867_del complete
Oct 26 09:58:07 user nova-compute[74075]: INFO nova.compute.manager [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 09:58:07 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 09:58:07 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:58:08 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Took 0.81 seconds to deallocate network for instance.
Oct 26 09:58:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-e55e62e9-ec74-422f-b029-054167696fc5 req-eb0e3cd8-9e7b-4a9a-9b6b-44d1ec05f960 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-deleted-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:58:08 user nova-compute[74075]: INFO nova.compute.manager [req-e55e62e9-ec74-422f-b029-054167696fc5 req-eb0e3cd8-9e7b-4a9a-9b6b-44d1ec05f960 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Neutron deleted interface fcb2810b-ead9-4019-9312-a77cc0d060c9; detaching it from the instance and deleting it from the info cache
Oct 26 09:58:08 user nova-compute[74075]: DEBUG nova.network.neutron [req-e55e62e9-ec74-422f-b029-054167696fc5 req-eb0e3cd8-9e7b-4a9a-9b6b-44d1ec05f960 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-e55e62e9-ec74-422f-b029-054167696fc5 req-eb0e3cd8-9e7b-4a9a-9b6b-44d1ec05f960 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Detach interface failed, port_id=fcb2810b-ead9-4019-9312-a77cc0d060c9, reason: Instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:58:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:08 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Deleted allocations for instance 9149ef7a-dfc7-4cf8-973e-74ef910c3867
Oct 26 09:58:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0f84998f-9f05-4376-87ff-f0f5bba36e29 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.984s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ecb1fd4-6565-4784-95d3-1254892b8497 req-6f85eb4f-22eb-443f-b327-71f44a0a1ec1 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:58:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ecb1fd4-6565-4784-95d3-1254892b8497 req-6f85eb4f-22eb-443f-b327-71f44a0a1ec1 service nova] Acquiring lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ecb1fd4-6565-4784-95d3-1254892b8497 req-6f85eb4f-22eb-443f-b327-71f44a0a1ec1 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:09 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ecb1fd4-6565-4784-95d3-1254892b8497 req-6f85eb4f-22eb-443f-b327-71f44a0a1ec1 service nova] Lock "9149ef7a-dfc7-4cf8-973e-74ef910c3867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ecb1fd4-6565-4784-95d3-1254892b8497 req-6f85eb4f-22eb-443f-b327-71f44a0a1ec1 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] No waiting events found dispatching network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:58:09 user nova-compute[74075]: WARNING nova.compute.manager [req-4ecb1fd4-6565-4784-95d3-1254892b8497 req-6f85eb4f-22eb-443f-b327-71f44a0a1ec1 service nova] [instance: 9149ef7a-dfc7-4cf8-973e-74ef910c3867] Received unexpected event network-vif-plugged-fcb2810b-ead9-4019-9312-a77cc0d060c9 for instance with vm_state deleted and task_state None.
Oct 26 09:58:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:58:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:58:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:58:17 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:58:17 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.317798614501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:58:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:58:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:58:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:58:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:58:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:58:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 09:58:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:58:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 09:58:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:58:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:58:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:59:01 user nova-compute[74075]: INFO nova.compute.claims [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Claim successful on node user
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:59:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.policy [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c88b9df9bbd4d09adc2e1846fae72b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f38f50a5217486f935724fd94a0d419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:59:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Creating image(s)
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk 1073741824" returned: 0 in 0.050s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Successfully created port: 928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.191s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Cannot resize image /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Ensure instance console log exists: /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Successfully updated port: 928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing instance network info cache due to event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance network_info: |[{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.neutron [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Start _get_guest_xml network_info=[{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:59:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:59:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1164231499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1164231499',id=42,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOm5dLnc4DLkomJncO1LEgERtA1ZEa58+ZFXJLSZrGhnElxnicXpTmXJVjm9CJgvc1+2VA+DwAf6nhQEX1EzGgaLNhfcJpiDZxJ7fmhMiJ77giBpoPjjeQXL1LJmlf8FA==',key_name='tempest-keypair-692346324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-lyoezlvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:59:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=4bb3b8c4-0901-45d9-911c-9a32a5e5120f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:59:03 user nova-compute[74075]:   <uuid>4bb3b8c4-0901-45d9-911c-9a32a5e5120f</uuid>
Oct 26 09:59:03 user nova-compute[74075]:   <name>instance-0000002a</name>
Oct 26 09:59:03 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:59:03 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:59:03 user nova-compute[74075]:   <metadata>
Oct 26 09:59:03 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:59:03 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:59:03 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1164231499</nova:name>
Oct 26 09:59:03 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:59:03</nova:creationTime>
Oct 26 09:59:03 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:59:03 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:59:03 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:59:03 user nova-compute[74075]:       <nova:owner>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:user uuid="1c88b9df9bbd4d09adc2e1846fae72b2">tempest-AttachVolumeShelveTestJSON-85318806-project-member</nova:user>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:project uuid="9f38f50a5217486f935724fd94a0d419">tempest-AttachVolumeShelveTestJSON-85318806</nova:project>
Oct 26 09:59:03 user nova-compute[74075]:       </nova:owner>
Oct 26 09:59:03 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 09:59:03 user nova-compute[74075]:       <nova:ports>
Oct 26 09:59:03 user nova-compute[74075]:         <nova:port uuid="928f91c4-b734-41d3-8755-408ab6fcd218">
Oct 26 09:59:03 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 09:59:03 user nova-compute[74075]:         </nova:port>
Oct 26 09:59:03 user nova-compute[74075]:       </nova:ports>
Oct 26 09:59:03 user nova-compute[74075]:     </nova:instance>
Oct 26 09:59:03 user nova-compute[74075]:   </metadata>
Oct 26 09:59:03 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:59:03 user nova-compute[74075]:     <system>
Oct 26 09:59:03 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:59:03 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:59:03 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:59:03 user nova-compute[74075]:       <entry name="serial">4bb3b8c4-0901-45d9-911c-9a32a5e5120f</entry>
Oct 26 09:59:03 user nova-compute[74075]:       <entry name="uuid">4bb3b8c4-0901-45d9-911c-9a32a5e5120f</entry>
Oct 26 09:59:03 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:59:03 user nova-compute[74075]:     </system>
Oct 26 09:59:03 user nova-compute[74075]:   </sysinfo>
Oct 26 09:59:03 user nova-compute[74075]:   <os>
Oct 26 09:59:03 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:59:03 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:59:03 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:59:03 user nova-compute[74075]:   </os>
Oct 26 09:59:03 user nova-compute[74075]:   <features>
Oct 26 09:59:03 user nova-compute[74075]:     <acpi/>
Oct 26 09:59:03 user nova-compute[74075]:     <apic/>
Oct 26 09:59:03 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:59:03 user nova-compute[74075]:   </features>
Oct 26 09:59:03 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:59:03 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:59:03 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:59:03 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:59:03 user nova-compute[74075]:   </clock>
Oct 26 09:59:03 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:59:03 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:59:03 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:59:03 user nova-compute[74075]:   </cpu>
Oct 26 09:59:03 user nova-compute[74075]:   <devices>
Oct 26 09:59:03 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 09:59:03 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 09:59:03 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk"/>
Oct 26 09:59:03 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:59:03 user nova-compute[74075]:     </disk>
Oct 26 09:59:03 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:59:03 user nova-compute[74075]:       <mac address="fa:16:3e:d5:83:43"/>
Oct 26 09:59:03 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:59:03 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:59:03 user nova-compute[74075]:       <target dev="tap928f91c4-b7"/>
Oct 26 09:59:03 user nova-compute[74075]:     </interface>
Oct 26 09:59:03 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:59:03 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/console.log" append="off"/>
Oct 26 09:59:03 user nova-compute[74075]:     </serial>
Oct 26 09:59:03 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:59:03 user nova-compute[74075]:     <video>
Oct 26 09:59:03 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:59:03 user nova-compute[74075]:     </video>
Oct 26 09:59:03 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:59:03 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:59:03 user nova-compute[74075]:     </rng>
Oct 26 09:59:03 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:59:03 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:59:03 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:59:03 user nova-compute[74075]:     </memballoon>
Oct 26 09:59:03 user nova-compute[74075]:   </devices>
Oct 26 09:59:03 user nova-compute[74075]: </domain>
Oct 26 09:59:03 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1164231499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1164231499',id=42,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOm5dLnc4DLkomJncO1LEgERtA1ZEa58+ZFXJLSZrGhnElxnicXpTmXJVjm9CJgvc1+2VA+DwAf6nhQEX1EzGgaLNhfcJpiDZxJ7fmhMiJ77giBpoPjjeQXL1LJmlf8FA==',key_name='tempest-keypair-692346324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-lyoezlvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:59:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=4bb3b8c4-0901-45d9-911c-9a32a5e5120f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG os_vif [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd711efd9-6cfd-5601-818c-c1bc1f004b2f', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap928f91c4-b7, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap928f91c4-b7, col_values=(('qos', UUID('7a2c7e43-b94f-4647-a830-d19f1e9fb02c')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap928f91c4-b7, col_values=(('external_ids', {'iface-id': '928f91c4-b734-41d3-8755-408ab6fcd218', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:83:43', 'vm-uuid': '4bb3b8c4-0901-45d9-911c-9a32a5e5120f'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:03 user nova-compute[74075]: INFO os_vif [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7')
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:59:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No VIF found with MAC fa:16:3e:d5:83:43, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:59:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated VIF entry in instance network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:59:04 user nova-compute[74075]: DEBUG nova.network.neutron [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:59:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-521e11bd-660a-49b8-b974-7dc18e511c1d req-8da9b5ad-5df3-4771-bd47-9b62d3e9879f service nova] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-c1172739-01c5-4ed0-a3d8-bcffe1ccfbfc req-e918533f-f6ff-43e5-ac01-b10b74c3cb53 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1172739-01c5-4ed0-a3d8-bcffe1ccfbfc req-e918533f-f6ff-43e5-ac01-b10b74c3cb53 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1172739-01c5-4ed0-a3d8-bcffe1ccfbfc req-e918533f-f6ff-43e5-ac01-b10b74c3cb53 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1172739-01c5-4ed0-a3d8-bcffe1ccfbfc req-e918533f-f6ff-43e5-ac01-b10b74c3cb53 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-c1172739-01c5-4ed0-a3d8-bcffe1ccfbfc req-e918533f-f6ff-43e5-ac01-b10b74c3cb53 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:59:05 user nova-compute[74075]: WARNING nova.compute.manager [req-c1172739-01c5-4ed0-a3d8-bcffe1ccfbfc req-e918533f-f6ff-43e5-ac01-b10b74c3cb53 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state building and task_state spawning.
Oct 26 09:59:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:59:07 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance spawned successfully.
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:07 user nova-compute[74075]: INFO nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:59:07 user nova-compute[74075]: INFO nova.compute.manager [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Took 6.12 seconds to build instance.
Oct 26 09:59:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8c78dc0e-c07d-4fbd-9086-6f762024ad89 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.224s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e112569-5d9c-46b2-a21e-713cb157c28e req-acb2f3da-b1ca-499c-ba1e-27d215eba4b2 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e112569-5d9c-46b2-a21e-713cb157c28e req-acb2f3da-b1ca-499c-ba1e-27d215eba4b2 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e112569-5d9c-46b2-a21e-713cb157c28e req-acb2f3da-b1ca-499c-ba1e-27d215eba4b2 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e112569-5d9c-46b2-a21e-713cb157c28e req-acb2f3da-b1ca-499c-ba1e-27d215eba4b2 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e112569-5d9c-46b2-a21e-713cb157c28e req-acb2f3da-b1ca-499c-ba1e-27d215eba4b2 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:59:07 user nova-compute[74075]: WARNING nova.compute.manager [req-1e112569-5d9c-46b2-a21e-713cb157c28e req-acb2f3da-b1ca-499c-ba1e-27d215eba4b2 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state None.
Oct 26 09:59:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:19 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:59:19 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.306419372558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 09:59:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 09:59:26 user nova-compute[74075]: INFO nova.compute.claims [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Claim successful on node user
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 09:59:26 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 09:59:26 user nova-compute[74075]: INFO nova.virt.block_device [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Booting with volume e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 at /dev/vda
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.policy [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67e1f88d9a1344728a5dae45a143ca44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca57ef52fd4457b941d5b75c3fc2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG os_brick.utils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd800e2-0a5f-4514-9690-3a05bf49b16d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc72cda-08b3-4f12-925e-5a4591ffcf8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b44164d-05c0-4301-bb09-d3bafec36e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8c54af-0b3c-4b88-8478-6fc8d1032af6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 09:59:26 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 09:59:26 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb88248-c04b-4540-a291-ed74960fdd9c]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG os_brick.utils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:59:26 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating existing volume attachment record: 02bf6e99-656d-4716-b94e-a48a04bfad74 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Successfully created port: 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Successfully updated port: 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing instance network info cache due to event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 09:59:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance network_info: |[{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updated VIF entry in instance network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-fd98f43c-b93f-4eb0-a6e5-4a22ad1d5902 req-2a4a00fe-1177-4387-9f5e-f98600831c26 service nova] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 09:59:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verify base images {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Image id dfb66725-6124-42bd-9a80-fc5728283531 yields fingerprint 210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] image dfb66725-6124-42bd-9a80-fc5728283531 at (/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f): checking
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] image dfb66725-6124-42bd-9a80-fc5728283531 at (/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f): image is in use {{(pid=74075) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] 4bb3b8c4-0901-45d9-911c-9a32a5e5120f is a valid instance name {{(pid=74075) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] 4bb3b8c4-0901-45d9-911c-9a32a5e5120f has a disk file {{(pid=74075) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f is backed by 210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f {{(pid=74075) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 09:59:41 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0
Oct 26 09:59:41 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5
Oct 26 09:59:41 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72
Oct 26 09:59:41 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37
Oct 26 09:59:41 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Active base files: /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Removable base files: /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5 /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37 /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37
Oct 26 09:59:41 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verification complete {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verify swap images {{(pid=74075) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 26 09:59:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verify ephemeral images {{(pid=74075) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 26 09:59:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 09:59:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Creating image(s)
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Ensure instance console log exists: /opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Start _get_guest_xml network_info=[{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '02bf6e99-656d-4716-b94e-a48a04bfad74', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3d4e536-9aa0-45f5-9c9e-9883017ca2e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'serial': 'e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 09:59:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:59:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 09:59:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:59:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 09:59:44 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20540ca-80a3-42ba-bbff-1fe7d7e8bf01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 09:59:44 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1eaf89-5c19-40de-b7de-719e2dd6d246]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99] added
Oct 26 09:59:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927275c-4586-40d3-a9c2-a014862fa110]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e18e25-9c46-4d33-b006-2d31bddc2970]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhNuKAlJ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhNuKAlJ" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a0021-1439-4560-91bd-72b15bccf7d6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhNuKAlJ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4a278-145c-436a-931b-2dfaaf9d7c32]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0698b08-3ea5-474a-9082-dbf179b55d4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:59:44 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 09:59:44 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:59:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 09:59:44 user nova-compute[74075]: 
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7020a5-3e1d-43fa-9d48-e06978e560c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]
Oct 26 09:59:44 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.
Oct 26 09:59:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a890df7-2039-400f-a798-ad00452f4d92]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b1598f-8467-4819-957b-8ea1c08988b6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 09:59:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 09:59:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7db6a1-a2e3-4eed-93e2-92e5fd0b5351]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 09:59:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26233383763323539', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233383763323539', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1784053241',display_name='tempest-TestShelveInstance-server-1784053241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1784053241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKviCUwE0fDypWxHQvzZk865NjCxGGaszmr3hcRNQCq/y2hg6ZW6gJFoCkABszx5HPsSi2wNPyIF30HWzFOmMMhgYoi9S0DH7gRHlXhkSWZfvjpKiqehePOicqZSyH5/rA==',key_name='tempest-TestShelveInstance-791750146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6ca57ef52fd4457b941d5b75c3fc2b0',ramdisk_id='',reservation_id='r-jup1ui7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1640843986',owner_user_name='tempest-TestShelveInstance-1640843986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:59:27Z,user_data=None,user_id='67e1f88d9a1344728a5dae45a143ca44',uuid=f3d4e536-9aa0-45f5-9c9e-9883017ca2e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converting VIF {"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'pci_devices' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 09:59:45 user nova-compute[74075]:   <uuid>f3d4e536-9aa0-45f5-9c9e-9883017ca2e8</uuid>
Oct 26 09:59:45 user nova-compute[74075]:   <name>instance-0000002b</name>
Oct 26 09:59:45 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 09:59:45 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 09:59:45 user nova-compute[74075]:   <metadata>
Oct 26 09:59:45 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 09:59:45 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 09:59:45 user nova-compute[74075]:       <nova:name>tempest-TestShelveInstance-server-1784053241</nova:name>
Oct 26 09:59:45 user nova-compute[74075]:       <nova:creationTime>2023-10-26 09:59:44</nova:creationTime>
Oct 26 09:59:45 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 09:59:45 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 09:59:45 user nova-compute[74075]:       </nova:flavor>
Oct 26 09:59:45 user nova-compute[74075]:       <nova:owner>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:user uuid="67e1f88d9a1344728a5dae45a143ca44">tempest-TestShelveInstance-1640843986-project-member</nova:user>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:project uuid="d6ca57ef52fd4457b941d5b75c3fc2b0">tempest-TestShelveInstance-1640843986</nova:project>
Oct 26 09:59:45 user nova-compute[74075]:       </nova:owner>
Oct 26 09:59:45 user nova-compute[74075]:       <nova:ports>
Oct 26 09:59:45 user nova-compute[74075]:         <nova:port uuid="74b76b57-fa8b-44ca-bbc5-fad9304b899a">
Oct 26 09:59:45 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 09:59:45 user nova-compute[74075]:         </nova:port>
Oct 26 09:59:45 user nova-compute[74075]:       </nova:ports>
Oct 26 09:59:45 user nova-compute[74075]:     </nova:instance>
Oct 26 09:59:45 user nova-compute[74075]:   </metadata>
Oct 26 09:59:45 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 09:59:45 user nova-compute[74075]:     <system>
Oct 26 09:59:45 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 09:59:45 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 09:59:45 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 09:59:45 user nova-compute[74075]:       <entry name="serial">f3d4e536-9aa0-45f5-9c9e-9883017ca2e8</entry>
Oct 26 09:59:45 user nova-compute[74075]:       <entry name="uuid">f3d4e536-9aa0-45f5-9c9e-9883017ca2e8</entry>
Oct 26 09:59:45 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 09:59:45 user nova-compute[74075]:     </system>
Oct 26 09:59:45 user nova-compute[74075]:   </sysinfo>
Oct 26 09:59:45 user nova-compute[74075]:   <os>
Oct 26 09:59:45 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 09:59:45 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 09:59:45 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 09:59:45 user nova-compute[74075]:   </os>
Oct 26 09:59:45 user nova-compute[74075]:   <features>
Oct 26 09:59:45 user nova-compute[74075]:     <acpi/>
Oct 26 09:59:45 user nova-compute[74075]:     <apic/>
Oct 26 09:59:45 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 09:59:45 user nova-compute[74075]:   </features>
Oct 26 09:59:45 user nova-compute[74075]:   <clock offset="utc">
Oct 26 09:59:45 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 09:59:45 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 09:59:45 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 09:59:45 user nova-compute[74075]:   </clock>
Oct 26 09:59:45 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 09:59:45 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 09:59:45 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 09:59:45 user nova-compute[74075]:   </cpu>
Oct 26 09:59:45 user nova-compute[74075]:   <devices>
Oct 26 09:59:45 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 09:59:45 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 09:59:45 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 09:59:45 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 09:59:45 user nova-compute[74075]:       <serial>e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99</serial>
Oct 26 09:59:45 user nova-compute[74075]:     </disk>
Oct 26 09:59:45 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 09:59:45 user nova-compute[74075]:       <mac address="fa:16:3e:90:d1:91"/>
Oct 26 09:59:45 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:59:45 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 09:59:45 user nova-compute[74075]:       <target dev="tap74b76b57-fa"/>
Oct 26 09:59:45 user nova-compute[74075]:     </interface>
Oct 26 09:59:45 user nova-compute[74075]:     <serial type="pty">
Oct 26 09:59:45 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8/console.log" append="off"/>
Oct 26 09:59:45 user nova-compute[74075]:     </serial>
Oct 26 09:59:45 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 09:59:45 user nova-compute[74075]:     <video>
Oct 26 09:59:45 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 09:59:45 user nova-compute[74075]:     </video>
Oct 26 09:59:45 user nova-compute[74075]:     <rng model="virtio">
Oct 26 09:59:45 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 09:59:45 user nova-compute[74075]:     </rng>
Oct 26 09:59:45 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 09:59:45 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 09:59:45 user nova-compute[74075]:       <stats period="10"/>
Oct 26 09:59:45 user nova-compute[74075]:     </memballoon>
Oct 26 09:59:45 user nova-compute[74075]:   </devices>
Oct 26 09:59:45 user nova-compute[74075]: </domain>
Oct 26 09:59:45 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1784053241',display_name='tempest-TestShelveInstance-server-1784053241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1784053241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKviCUwE0fDypWxHQvzZk865NjCxGGaszmr3hcRNQCq/y2hg6ZW6gJFoCkABszx5HPsSi2wNPyIF30HWzFOmMMhgYoi9S0DH7gRHlXhkSWZfvjpKiqehePOicqZSyH5/rA==',key_name='tempest-TestShelveInstance-791750146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6ca57ef52fd4457b941d5b75c3fc2b0',ramdisk_id='',reservation_id='r-jup1ui7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1640843986',owner_user_name='tempest-TestShelveInstance-1640843986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T09:59:27Z,user_data=None,user_id='67e1f88d9a1344728a5dae45a143ca44',uuid=f3d4e536-9aa0-45f5-9c9e-9883017ca2e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converting VIF {"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG os_vif [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '292b5f91-1574-598b-b1a7-764b99fa45b4', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74b76b57-fa, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74b76b57-fa, col_values=(('qos', UUID('a43db55b-2551-4f67-825c-165851d83ecb')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74b76b57-fa, col_values=(('external_ids', {'iface-id': '74b76b57-fa8b-44ca-bbc5-fad9304b899a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:d1:91', 'vm-uuid': 'f3d4e536-9aa0-45f5-9c9e-9883017ca2e8'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:45 user nova-compute[74075]: INFO os_vif [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa')
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 09:59:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] No VIF found with MAC fa:16:3e:90:d1:91, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-1b4fc314-dbcd-4301-b766-2ada6a9e7c3e req-be558ced-5550-4ba8-8e58-3525f72bdbeb service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1b4fc314-dbcd-4301-b766-2ada6a9e7c3e req-be558ced-5550-4ba8-8e58-3525f72bdbeb service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1b4fc314-dbcd-4301-b766-2ada6a9e7c3e req-be558ced-5550-4ba8-8e58-3525f72bdbeb service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1b4fc314-dbcd-4301-b766-2ada6a9e7c3e req-be558ced-5550-4ba8-8e58-3525f72bdbeb service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:46 user nova-compute[74075]: DEBUG nova.compute.manager [req-1b4fc314-dbcd-4301-b766-2ada6a9e7c3e req-be558ced-5550-4ba8-8e58-3525f72bdbeb service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:59:46 user nova-compute[74075]: WARNING nova.compute.manager [req-1b4fc314-dbcd-4301-b766-2ada6a9e7c3e req-be558ced-5550-4ba8-8e58-3525f72bdbeb service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state building and task_state spawning.
Oct 26 09:59:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 09:59:48 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance spawned successfully.
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 09:59:48 user nova-compute[74075]: INFO nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Took 4.81 seconds to spawn the instance on the hypervisor.
Oct 26 09:59:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 09:59:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-91da9f93-57b8-4a84-a69f-5d03173ae6aa req-85d06a61-3bca-4308-bb56-7f76d06c763c service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 09:59:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-91da9f93-57b8-4a84-a69f-5d03173ae6aa req-85d06a61-3bca-4308-bb56-7f76d06c763c service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 09:59:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-91da9f93-57b8-4a84-a69f-5d03173ae6aa req-85d06a61-3bca-4308-bb56-7f76d06c763c service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 09:59:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-91da9f93-57b8-4a84-a69f-5d03173ae6aa req-85d06a61-3bca-4308-bb56-7f76d06c763c service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-91da9f93-57b8-4a84-a69f-5d03173ae6aa req-85d06a61-3bca-4308-bb56-7f76d06c763c service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 09:59:49 user nova-compute[74075]: WARNING nova.compute.manager [req-91da9f93-57b8-4a84-a69f-5d03173ae6aa req-85d06a61-3bca-4308-bb56-7f76d06c763c service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state building and task_state spawning.
Oct 26 09:59:49 user nova-compute[74075]: INFO nova.compute.manager [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Took 22.80 seconds to build instance.
Oct 26 09:59:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e9422d59-71e7-4388-b3bd-6f1b89c9960c tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.894s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 09:59:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 09:59:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:00:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:16 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:00:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:00:18 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:00:18 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:00:18 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.276790618896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:00:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:00:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:00:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:24 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:00:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:00:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:00:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:00:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:00:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:00:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:00:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG nova.compute.manager [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing instance network info cache due to event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG nova.network.neutron [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG nova.network.neutron [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated VIF entry in instance network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG nova.network.neutron [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f0afc7d-4be1-4bd9-a8cb-065494276023 req-ff1214cd-a7a3-4b71-b3bf-321604576e14 service nova] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:00:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:00:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:00 user nova-compute[74075]: INFO nova.compute.manager [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Shelving
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-a0f714ff-a904-487a-872e-92c5ec1a17e0 req-e544decf-3322-4e33-8f30-1c4d6416655d service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a0f714ff-a904-487a-872e-92c5ec1a17e0 req-e544decf-3322-4e33-8f30-1c4d6416655d service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a0f714ff-a904-487a-872e-92c5ec1a17e0 req-e544decf-3322-4e33-8f30-1c4d6416655d service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a0f714ff-a904-487a-872e-92c5ec1a17e0 req-e544decf-3322-4e33-8f30-1c4d6416655d service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-a0f714ff-a904-487a-872e-92c5ec1a17e0 req-e544decf-3322-4e33-8f30-1c4d6416655d service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:00 user nova-compute[74075]: WARNING nova.compute.manager [req-a0f714ff-a904-487a-872e-92c5ec1a17e0 req-e544decf-3322-4e33-8f30-1c4d6416655d service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state shelving.
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance destroyed successfully.
Oct 26 10:01:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:00 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Beginning cold snapshot process
Oct 26 10:01:01 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk /opt/stack/data/nova/instances/snapshots/tmpwk92gq4x/a1c9f9fc2b96425bb6a36453f75bb022 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk /opt/stack/data/nova/instances/snapshots/tmpwk92gq4x/a1c9f9fc2b96425bb6a36453f75bb022" returned: 0 in 0.547s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Snapshot extracted, beginning image upload
Oct 26 10:01:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:02 user nova-compute[74075]: WARNING nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:02 user nova-compute[74075]: WARNING nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:02 user nova-compute[74075]: WARNING nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:02 user nova-compute[74075]: WARNING nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:02 user nova-compute[74075]: WARNING nova.compute.manager [req-3f652815-5d4c-423b-80ad-c6d8289a8b49 req-c6bf4b5c-8278-4188-9948-3ab07c01f7f6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 10:01:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Snapshot image upload complete
Oct 26 10:01:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:01:04 user nova-compute[74075]: INFO nova.compute.manager [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Shelve offloading
Oct 26 10:01:04 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance destroyed successfully.
Oct 26 10:01:04 user nova-compute[74075]: DEBUG nova.compute.manager [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:01:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:01:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:01:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:01:04 user nova-compute[74075]: DEBUG nova.network.neutron [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:01:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:01:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance destroyed successfully.
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'resources' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1164231499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1164231499',id=42,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOm5dLnc4DLkomJncO1LEgERtA1ZEa58+ZFXJLSZrGhnElxnicXpTmXJVjm9CJgvc1+2VA+DwAf6nhQEX1EzGgaLNhfcJpiDZxJ7fmhMiJ77giBpoPjjeQXL1LJmlf8FA==',key_name='tempest-keypair-692346324',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-lyoezlvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member',shelved_at='2023-10-26T10:01:04.057020',shelved_host='user',shelved_image_id='6b511935-bd95-4660-add4-27e7ff990587'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=4bb3b8c4-0901-45d9-911c-9a32a5e5120f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG os_vif [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap928f91c4-b7, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing instance network info cache due to event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a2c7e43-b94f-4647-a830-d19f1e9fb02c) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:05 user nova-compute[74075]: INFO os_vif [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7')
Oct 26 10:01:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Deleting instance files /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f_del
Oct 26 10:01:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Deletion of /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f_del complete
Oct 26 10:01:05 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Deleted allocations for instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'numa_topology' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.objects.base [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<4bb3b8c4-0901-45d9-911c-9a32a5e5120f> lazy-loaded attributes: resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-37456766-39c2-47e6-8c37-49cd5ab4f6e6 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.290s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated VIF entry in instance network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG nova.network.neutron [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap928f91c4-b7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:01:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-70b9142f-8dd6-4e90-a2c0-c4af4290516c req-eb6b6467-e16e-4d27-aa32-fb600681ff22 service nova] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:01:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:17 user nova-compute[74075]: DEBUG nova.compute.manager [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing instance network info cache due to event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:01:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:01:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:01:17 user nova-compute[74075]: DEBUG nova.network.neutron [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:01:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG nova.network.neutron [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updated VIF entry in instance network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG nova.network.neutron [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-27934776-320d-4306-9e0a-395ca73c3e8a req-15119ab8-4e9c-484d-ac34-c65ff58c2fac service nova] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:18 user nova-compute[74075]: INFO nova.compute.manager [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Shelve offloading
Oct 26 10:01:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 10:01:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:01:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance destroyed successfully.
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:01:19 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:01:19 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=25.254741668701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-unplugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-unplugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:19 user nova-compute[74075]: WARNING nova.compute.manager [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-unplugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state active and task_state shelving.
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:01:19 user nova-compute[74075]: WARNING nova.compute.manager [req-55c22597-8fd3-4be7-ae04-bb01c26d8bb3 req-2e1e68ea-90a4-4227-9e0f-aa67189db0ca service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state active and task_state shelving.
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance destroyed successfully.
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'resources' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T09:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1784053241',display_name='tempest-TestShelveInstance-server-1784053241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1784053241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKviCUwE0fDypWxHQvzZk865NjCxGGaszmr3hcRNQCq/y2hg6ZW6gJFoCkABszx5HPsSi2wNPyIF30HWzFOmMMhgYoi9S0DH7gRHlXhkSWZfvjpKiqehePOicqZSyH5/rA==',key_name='tempest-TestShelveInstance-791750146',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6ca57ef52fd4457b941d5b75c3fc2b0',ramdisk_id='',reservation_id='r-jup1ui7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1640843986',owner_user_name='tempest-TestShelveInstance-1640843986-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T09:59:49Z,user_data=None,user_id='67e1f88d9a1344728a5dae45a143ca44',uuid=f3d4e536-9aa0-45f5-9c9e-9883017ca2e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converting VIF {"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_vif [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74b76b57-fa, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a43db55b-2551-4f67-825c-165851d83ecb) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing instance network info cache due to event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.network.neutron [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:20 user nova-compute[74075]: INFO os_vif [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa')
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:01:20 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3cb881-845b-47cf-bd71-a2c0c3e994f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:01:20 user nova-compute[74075]: No targets found.
Oct 26 10:01:20 user nova-compute[74075]: iSNS:
Oct 26 10:01:20 user nova-compute[74075]: No targets found.
Oct 26 10:01:20 user nova-compute[74075]: STATIC:
Oct 26 10:01:20 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99
Oct 26 10:01:20 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:01:20 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:01:20 user nova-compute[74075]: FIRMWARE:
Oct 26 10:01:20 user nova-compute[74075]: No targets found.
Oct 26 10:01:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:01:20 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:01:20 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e7ee80-09dd-4c20-adc8-dbddc8a2b6d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b199f3d-c01f-4203-b9f7-6c5e34023c39]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 10:01:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 10:01:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1f5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a84da6-f160-4686-93eb-7031dda2489b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f762b-de84-4db0-8492-e3805591ccea]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828641f-d4b5-4114-8226-c8c37454614d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8515f0-4f4b-4484-bed6-69e2197028f5]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b9537b-3856-42df-9f76-58b67360d3d2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00380d3-e591-4c02-80f8-76a99796df82]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]
Oct 26 10:01:20 user nova-compute[74075]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.
Oct 26 10:01:20 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef731f-3528-408d-ad58-60bd2147c48c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] <== disconnect_volume: return (261ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:01:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Deleting instance files /opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8_del
Oct 26 10:01:20 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Deletion of /opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8_del complete
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:01:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.network.neutron [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updated VIF entry in instance network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.network.neutron [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": null, "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap74b76b57-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-642d107d-6094-4946-ae85-11be81c2e639 req-5989c5aa-ba9e-47a8-83d4-705655805aa1 service nova] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": null, "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap74b76b57-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:21 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Deleted allocations for instance f3d4e536-9aa0-45f5-9c9e-9883017ca2e8
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'numa_topology' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.objects.base [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Object Instance<f3d4e536-9aa0-45f5-9c9e-9883017ca2e8> lazy-loaded attributes: resources,numa_topology {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.091s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-8cd571f0-d413-4ff6-99e0-c1ee24e10faf tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.539s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.113s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:01:21 user nova-compute[74075]: INFO nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] During sync_power_state the instance has a pending task (shelving). Skip.
Oct 26 10:01:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:01:22 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:01:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:01:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:01:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:01:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:01:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:01:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:01:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:01:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:01:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:01:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:02:20 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:02:20 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9049MB free_disk=25.254058837890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:02:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:24 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:02:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:02:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:52 user nova-compute[74075]: INFO nova.compute.manager [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Unshelving
Oct 26 10:02:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:52 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'pci_requests' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:02:52 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'numa_topology' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:02:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:02:52 user nova-compute[74075]: INFO nova.compute.claims [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Claim successful on node user
Oct 26 10:02:53 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:53 user nova-compute[74075]: INFO nova.network.neutron [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating port 928f91c4-b734-41d3-8755-408ab6fcd218 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing instance network info cache due to event network-changed-928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:02:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG nova.network.neutron [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:02:54 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Creating image(s)
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG nova.network.neutron [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Refreshing network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG nova.objects.base [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<4bb3b8c4-0901-45d9-911c-9a32a5e5120f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "f532cfabde3e6fded26663de4a32d9c04dbfae4a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "f532cfabde3e6fded26663de4a32d9c04dbfae4a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG nova.virt.images [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] 6b511935-bd95-4660-add4-27e7ff990587 was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.part /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated VIF entry in instance network info cache for port 928f91c4-b734-41d3-8755-408ab6fcd218. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG nova.network.neutron [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4ca03987-eef2-4279-a4e5-06b79a1ebf81 req-c95de21f-6780-4a4c-a3f1-02752d1ffea0 service nova] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.part /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.converted" returned: 0 in 0.450s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "f532cfabde3e6fded26663de4a32d9c04dbfae4a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.770s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "f532cfabde3e6fded26663de4a32d9c04dbfae4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "f532cfabde3e6fded26663de4a32d9c04dbfae4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a,backing_fmt=raw /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a,backing_fmt=raw /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk 1073741824" returned: 0 in 0.050s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "f532cfabde3e6fded26663de4a32d9c04dbfae4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'migration_context' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG nova.objects.base [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<4bb3b8c4-0901-45d9-911c-9a32a5e5120f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:02:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Rebasing disk image.
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f -F raw /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f -F raw /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk" returned: 0 in 2.000s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Ensure instance console log exists: /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Start _get_guest_xml network_info=[{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='277b108ef457b9917836d35f6194851d',container_format='bare',created_at=2023-10-26T10:01:00Z,direct_url=<?>,disk_format='qcow2',id=6b511935-bd95-4660-add4-27e7ff990587,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1164231499-shelved',owner='9f38f50a5217486f935724fd94a0d419',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T10:01:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:02:58 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:02:58 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='277b108ef457b9917836d35f6194851d',container_format='bare',created_at=2023-10-26T10:01:00Z,direct_url=<?>,disk_format='qcow2',id=6b511935-bd95-4660-add4-27e7ff990587,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1164231499-shelved',owner='9f38f50a5217486f935724fd94a0d419',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T10:01:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.objects.base [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<4bb3b8c4-0901-45d9-911c-9a32a5e5120f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1164231499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1164231499',id=42,image_ref='6b511935-bd95-4660-add4-27e7ff990587',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-692346324',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-lyoezlvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member',shelved_at='2023-10-26T10:01:04.057020',shelved_host='user',shelved_image_id='6b511935-bd95-4660-add4-27e7ff990587'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=4bb3b8c4-0901-45d9-911c-9a32a5e5120f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.objects.base [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Object Instance<4bb3b8c4-0901-45d9-911c-9a32a5e5120f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:02:58 user nova-compute[74075]:   <uuid>4bb3b8c4-0901-45d9-911c-9a32a5e5120f</uuid>
Oct 26 10:02:58 user nova-compute[74075]:   <name>instance-0000002a</name>
Oct 26 10:02:58 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:02:58 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:02:58 user nova-compute[74075]:   <metadata>
Oct 26 10:02:58 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:02:58 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:02:58 user nova-compute[74075]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1164231499</nova:name>
Oct 26 10:02:58 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:02:58</nova:creationTime>
Oct 26 10:02:58 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:02:58 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:02:58 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:02:58 user nova-compute[74075]:       <nova:owner>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:user uuid="1c88b9df9bbd4d09adc2e1846fae72b2">tempest-AttachVolumeShelveTestJSON-85318806-project-member</nova:user>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:project uuid="9f38f50a5217486f935724fd94a0d419">tempest-AttachVolumeShelveTestJSON-85318806</nova:project>
Oct 26 10:02:58 user nova-compute[74075]:       </nova:owner>
Oct 26 10:02:58 user nova-compute[74075]:       <nova:root type="image" uuid="6b511935-bd95-4660-add4-27e7ff990587"/>
Oct 26 10:02:58 user nova-compute[74075]:       <nova:ports>
Oct 26 10:02:58 user nova-compute[74075]:         <nova:port uuid="928f91c4-b734-41d3-8755-408ab6fcd218">
Oct 26 10:02:58 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 10:02:58 user nova-compute[74075]:         </nova:port>
Oct 26 10:02:58 user nova-compute[74075]:       </nova:ports>
Oct 26 10:02:58 user nova-compute[74075]:     </nova:instance>
Oct 26 10:02:58 user nova-compute[74075]:   </metadata>
Oct 26 10:02:58 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:02:58 user nova-compute[74075]:     <system>
Oct 26 10:02:58 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:02:58 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:02:58 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:02:58 user nova-compute[74075]:       <entry name="serial">4bb3b8c4-0901-45d9-911c-9a32a5e5120f</entry>
Oct 26 10:02:58 user nova-compute[74075]:       <entry name="uuid">4bb3b8c4-0901-45d9-911c-9a32a5e5120f</entry>
Oct 26 10:02:58 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:02:58 user nova-compute[74075]:     </system>
Oct 26 10:02:58 user nova-compute[74075]:   </sysinfo>
Oct 26 10:02:58 user nova-compute[74075]:   <os>
Oct 26 10:02:58 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:02:58 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:02:58 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:02:58 user nova-compute[74075]:   </os>
Oct 26 10:02:58 user nova-compute[74075]:   <features>
Oct 26 10:02:58 user nova-compute[74075]:     <acpi/>
Oct 26 10:02:58 user nova-compute[74075]:     <apic/>
Oct 26 10:02:58 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:02:58 user nova-compute[74075]:   </features>
Oct 26 10:02:58 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:02:58 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:02:58 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:02:58 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:02:58 user nova-compute[74075]:   </clock>
Oct 26 10:02:58 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:02:58 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:02:58 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:02:58 user nova-compute[74075]:   </cpu>
Oct 26 10:02:58 user nova-compute[74075]:   <devices>
Oct 26 10:02:58 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 10:02:58 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 10:02:58 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk"/>
Oct 26 10:02:58 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:02:58 user nova-compute[74075]:     </disk>
Oct 26 10:02:58 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:02:58 user nova-compute[74075]:       <mac address="fa:16:3e:d5:83:43"/>
Oct 26 10:02:58 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:02:58 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:02:58 user nova-compute[74075]:       <target dev="tap928f91c4-b7"/>
Oct 26 10:02:58 user nova-compute[74075]:     </interface>
Oct 26 10:02:58 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:02:58 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/console.log" append="off"/>
Oct 26 10:02:58 user nova-compute[74075]:     </serial>
Oct 26 10:02:58 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:02:58 user nova-compute[74075]:     <video>
Oct 26 10:02:58 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:02:58 user nova-compute[74075]:     </video>
Oct 26 10:02:58 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:02:58 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:02:58 user nova-compute[74075]:     </rng>
Oct 26 10:02:58 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:02:58 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:02:58 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:02:58 user nova-compute[74075]:     </memballoon>
Oct 26 10:02:58 user nova-compute[74075]:   </devices>
Oct 26 10:02:58 user nova-compute[74075]: </domain>
Oct 26 10:02:58 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1164231499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1164231499',id=42,image_ref='6b511935-bd95-4660-add4-27e7ff990587',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-692346324',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-lyoezlvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member',shelved_at='2023-10-26T10:01:04.057020',shelved_host='user',shelved_image_id='6b511935-bd95-4660-add4-27e7ff990587'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=4bb3b8c4-0901-45d9-911c-9a32a5e5120f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG os_vif [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd711efd9-6cfd-5601-818c-c1bc1f004b2f', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap928f91c4-b7, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap928f91c4-b7, col_values=(('qos', UUID('2ceed7b7-3cf1-476e-b767-a89767720d70')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap928f91c4-b7, col_values=(('external_ids', {'iface-id': '928f91c4-b734-41d3-8755-408ab6fcd218', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:83:43', 'vm-uuid': '4bb3b8c4-0901-45d9-911c-9a32a5e5120f'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:02:58 user nova-compute[74075]: INFO os_vif [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7')
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:02:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] No VIF found with MAC fa:16:3e:d5:83:43, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-8b3f2723-cb8a-4dfa-b010-bf4f1b6aad43 req-118413b3-78df-43f5-8f4b-2073ab5835d6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8b3f2723-cb8a-4dfa-b010-bf4f1b6aad43 req-118413b3-78df-43f5-8f4b-2073ab5835d6 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8b3f2723-cb8a-4dfa-b010-bf4f1b6aad43 req-118413b3-78df-43f5-8f4b-2073ab5835d6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8b3f2723-cb8a-4dfa-b010-bf4f1b6aad43 req-118413b3-78df-43f5-8f4b-2073ab5835d6 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-8b3f2723-cb8a-4dfa-b010-bf4f1b6aad43 req-118413b3-78df-43f5-8f4b-2073ab5835d6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:03:00 user nova-compute[74075]: WARNING nova.compute.manager [req-8b3f2723-cb8a-4dfa-b010-bf4f1b6aad43 req-118413b3-78df-43f5-8f4b-2073ab5835d6 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 10:03:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a4610d3-83b8-4eb6-aa53-527c905f7b1a req-f57ab832-ed2d-4130-9a35-17fe4764a03e service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a4610d3-83b8-4eb6-aa53-527c905f7b1a req-f57ab832-ed2d-4130-9a35-17fe4764a03e service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a4610d3-83b8-4eb6-aa53-527c905f7b1a req-f57ab832-ed2d-4130-9a35-17fe4764a03e service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a4610d3-83b8-4eb6-aa53-527c905f7b1a req-f57ab832-ed2d-4130-9a35-17fe4764a03e service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a4610d3-83b8-4eb6-aa53-527c905f7b1a req-f57ab832-ed2d-4130-9a35-17fe4764a03e service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:03:02 user nova-compute[74075]: WARNING nova.compute.manager [req-3a4610d3-83b8-4eb6-aa53-527c905f7b1a req-f57ab832-ed2d-4130-9a35-17fe4764a03e service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 10:03:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:03:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance spawned successfully.
Oct 26 10:03:02 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:03:02 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6ed2f16c-72be-442f-bb91-bf00ddad2205 tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.135s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:10 user nova-compute[74075]: INFO nova.compute.manager [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Unshelving
Oct 26 10:03:10 user nova-compute[74075]: INFO nova.virt.block_device [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Booting with volume e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 at /dev/vda
Oct 26 10:03:10 user nova-compute[74075]: DEBUG os_brick.utils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[64686053-716b-4ad1-863d-a4a339be6706]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a68f7e-5bde-4d74-9bae-6c5c3365bd38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc8ac18-41c6-42f3-8a63-545bc40b4094]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[691e0f28-79d2-47bd-963f-e2744807fc76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:03:10 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:03:10 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82208d-8b34-4b43-801d-a6d6e9ae2526]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG os_brick.utils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:03:10 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating existing volume attachment record: dcf77719-94eb-4a63-98d6-48a6cc183251 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:03:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:20 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:21 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:03:21 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:03:21 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.227825164794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:03:22 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'pci_requests' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'numa_topology' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:03:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:03:27 user nova-compute[74075]: INFO nova.compute.claims [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Claim successful on node user
Oct 26 10:03:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:28 user nova-compute[74075]: INFO nova.network.neutron [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating port 74b76b57-fa8b-44ca-bbc5-fad9304b899a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing instance network info cache due to event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:03:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:03:29 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Creating image(s)
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Ensure instance console log exists: /opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Start _get_guest_xml network_info=[{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'dcf77719-94eb-4a63-98d6-48a6cc183251', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3d4e536-9aa0-45f5-9c9e-9883017ca2e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'serial': 'e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:03:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:03:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.objects.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Object Instance<f3d4e536-9aa0-45f5-9c9e-9883017ca2e8> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:03:29 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:03:29 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:03:29 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee72f29-de3f-4272-ab21-cc2cff416fbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:03:29 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba580bc-5474-4797-8840-9b43a63c7feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99] added
Oct 26 10:03:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b36628-c06a-4be0-91f4-a49edc343212]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f2e60-bffc-4aa1-9599-107a335b97a7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhNuKAlJ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhNuKAlJ" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad4495-a7b9-4b06-85e8-c192bef1b54d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhNuKAlJ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a34a73-25ee-480f-ba23-9da377bedd9b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c8fdf-2b17-4a2e-868a-aec565a18471]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:03:29 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:03:29 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:03:29 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:03:29 user nova-compute[74075]: 
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43bc6fb-2f55-49db-bc36-1c096b4e937b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]
Oct 26 10:03:29 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.
Oct 26 10:03:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49cc9a0-f5d6-43be-b64d-3637d6042094]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9e32a-fa3b-44b5-9176-2c700fda9915]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 10:03:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 10:03:29 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b329395-dfe1-4341-909d-d71d0257e716]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updated VIF entry in instance network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:03:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f5a13774-252d-4667-aa72-2909cafaf7fe req-249f0071-5ba3-4652-9b71-bc5a35130b8e service nova] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26233383763323539', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233383763323539', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1784053241',display_name='tempest-TestShelveInstance-server-1784053241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1784053241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-791750146',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d6ca57ef52fd4457b941d5b75c3fc2b0',ramdisk_id='',reservation_id='r-jup1ui7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1640843986',owner_user_name='tempest-TestShelveInstance-1640843986-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:03:10Z,user_data=None,user_id='67e1f88d9a1344728a5dae45a143ca44',uuid=f3d4e536-9aa0-45f5-9c9e-9883017ca2e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converting VIF {"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'pci_devices' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.objects.base [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Object Instance<f3d4e536-9aa0-45f5-9c9e-9883017ca2e8> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:03:30 user nova-compute[74075]:   <uuid>f3d4e536-9aa0-45f5-9c9e-9883017ca2e8</uuid>
Oct 26 10:03:30 user nova-compute[74075]:   <name>instance-0000002b</name>
Oct 26 10:03:30 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:03:30 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:03:30 user nova-compute[74075]:   <metadata>
Oct 26 10:03:30 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:03:30 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:03:30 user nova-compute[74075]:       <nova:name>tempest-TestShelveInstance-server-1784053241</nova:name>
Oct 26 10:03:30 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:03:29</nova:creationTime>
Oct 26 10:03:30 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:03:30 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:03:30 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:03:30 user nova-compute[74075]:       <nova:owner>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:user uuid="67e1f88d9a1344728a5dae45a143ca44">tempest-TestShelveInstance-1640843986-project-member</nova:user>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:project uuid="d6ca57ef52fd4457b941d5b75c3fc2b0">tempest-TestShelveInstance-1640843986</nova:project>
Oct 26 10:03:30 user nova-compute[74075]:       </nova:owner>
Oct 26 10:03:30 user nova-compute[74075]:       <nova:ports>
Oct 26 10:03:30 user nova-compute[74075]:         <nova:port uuid="74b76b57-fa8b-44ca-bbc5-fad9304b899a">
Oct 26 10:03:30 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 10:03:30 user nova-compute[74075]:         </nova:port>
Oct 26 10:03:30 user nova-compute[74075]:       </nova:ports>
Oct 26 10:03:30 user nova-compute[74075]:     </nova:instance>
Oct 26 10:03:30 user nova-compute[74075]:   </metadata>
Oct 26 10:03:30 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:03:30 user nova-compute[74075]:     <system>
Oct 26 10:03:30 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:03:30 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:03:30 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:03:30 user nova-compute[74075]:       <entry name="serial">f3d4e536-9aa0-45f5-9c9e-9883017ca2e8</entry>
Oct 26 10:03:30 user nova-compute[74075]:       <entry name="uuid">f3d4e536-9aa0-45f5-9c9e-9883017ca2e8</entry>
Oct 26 10:03:30 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:03:30 user nova-compute[74075]:     </system>
Oct 26 10:03:30 user nova-compute[74075]:   </sysinfo>
Oct 26 10:03:30 user nova-compute[74075]:   <os>
Oct 26 10:03:30 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:03:30 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:03:30 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:03:30 user nova-compute[74075]:   </os>
Oct 26 10:03:30 user nova-compute[74075]:   <features>
Oct 26 10:03:30 user nova-compute[74075]:     <acpi/>
Oct 26 10:03:30 user nova-compute[74075]:     <apic/>
Oct 26 10:03:30 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:03:30 user nova-compute[74075]:   </features>
Oct 26 10:03:30 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:03:30 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:03:30 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:03:30 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:03:30 user nova-compute[74075]:   </clock>
Oct 26 10:03:30 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:03:30 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:03:30 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:03:30 user nova-compute[74075]:   </cpu>
Oct 26 10:03:30 user nova-compute[74075]:   <devices>
Oct 26 10:03:30 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:03:30 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:03:30 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 10:03:30 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:03:30 user nova-compute[74075]:       <serial>e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99</serial>
Oct 26 10:03:30 user nova-compute[74075]:     </disk>
Oct 26 10:03:30 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:03:30 user nova-compute[74075]:       <mac address="fa:16:3e:90:d1:91"/>
Oct 26 10:03:30 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:03:30 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:03:30 user nova-compute[74075]:       <target dev="tap74b76b57-fa"/>
Oct 26 10:03:30 user nova-compute[74075]:     </interface>
Oct 26 10:03:30 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:03:30 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8/console.log" append="off"/>
Oct 26 10:03:30 user nova-compute[74075]:     </serial>
Oct 26 10:03:30 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:03:30 user nova-compute[74075]:     <video>
Oct 26 10:03:30 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:03:30 user nova-compute[74075]:     </video>
Oct 26 10:03:30 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:03:30 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:03:30 user nova-compute[74075]:     </rng>
Oct 26 10:03:30 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:03:30 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:03:30 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:03:30 user nova-compute[74075]:     </memballoon>
Oct 26 10:03:30 user nova-compute[74075]:   </devices>
Oct 26 10:03:30 user nova-compute[74075]: </domain>
Oct 26 10:03:30 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1784053241',display_name='tempest-TestShelveInstance-server-1784053241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1784053241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-791750146',keypairs=<?>,launch_index=0,launched_at=2023-10-26T09:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d6ca57ef52fd4457b941d5b75c3fc2b0',ramdisk_id='',reservation_id='r-jup1ui7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1640843986',owner_user_name='tempest-TestShelveInstance-1640843986-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:03:10Z,user_data=None,user_id='67e1f88d9a1344728a5dae45a143ca44',uuid=f3d4e536-9aa0-45f5-9c9e-9883017ca2e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converting VIF {"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG os_vif [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '292b5f91-1574-598b-b1a7-764b99fa45b4', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74b76b57-fa, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74b76b57-fa, col_values=(('qos', UUID('0a528661-fb87-40db-a703-6eb474ce99f9')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74b76b57-fa, col_values=(('external_ids', {'iface-id': '74b76b57-fa8b-44ca-bbc5-fad9304b899a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:d1:91', 'vm-uuid': 'f3d4e536-9aa0-45f5-9c9e-9883017ca2e8'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:30 user nova-compute[74075]: INFO os_vif [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa')
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:03:30 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] No VIF found with MAC fa:16:3e:90:d1:91, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:03:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:03:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-da3f6a7b-2ae6-48c9-9ba4-a2effc78b0e4 req-eaa98d98-dee2-4e3c-8d27-ad87e6bc9c44 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-da3f6a7b-2ae6-48c9-9ba4-a2effc78b0e4 req-eaa98d98-dee2-4e3c-8d27-ad87e6bc9c44 service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-da3f6a7b-2ae6-48c9-9ba4-a2effc78b0e4 req-eaa98d98-dee2-4e3c-8d27-ad87e6bc9c44 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-da3f6a7b-2ae6-48c9-9ba4-a2effc78b0e4 req-eaa98d98-dee2-4e3c-8d27-ad87e6bc9c44 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-da3f6a7b-2ae6-48c9-9ba4-a2effc78b0e4 req-eaa98d98-dee2-4e3c-8d27-ad87e6bc9c44 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:03:32 user nova-compute[74075]: WARNING nova.compute.manager [req-da3f6a7b-2ae6-48c9-9ba4-a2effc78b0e4 req-eaa98d98-dee2-4e3c-8d27-ad87e6bc9c44 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 10:03:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:03:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance spawned successfully.
Oct 26 10:03:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e0dce35d-c838-4a63-b995-812b2f4daaf7 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.073s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-f7cf1551-82a7-4fda-8fbc-a4b41838cde6 req-23a1d45e-ac31-48e7-a907-10249d73a213 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f7cf1551-82a7-4fda-8fbc-a4b41838cde6 req-23a1d45e-ac31-48e7-a907-10249d73a213 service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f7cf1551-82a7-4fda-8fbc-a4b41838cde6 req-23a1d45e-ac31-48e7-a907-10249d73a213 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f7cf1551-82a7-4fda-8fbc-a4b41838cde6 req-23a1d45e-ac31-48e7-a907-10249d73a213 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:03:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-f7cf1551-82a7-4fda-8fbc-a4b41838cde6 req-23a1d45e-ac31-48e7-a907-10249d73a213 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:03:34 user nova-compute[74075]: WARNING nova.compute.manager [req-f7cf1551-82a7-4fda-8fbc-a4b41838cde6 req-23a1d45e-ac31-48e7-a907-10249d73a213 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state active and task_state None.
Oct 26 10:03:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:03:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:03:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:03:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:03:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:03:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:04:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:04:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:04:23 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:04:23 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:04:23 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.226154327392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:04:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [{"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-4bb3b8c4-0901-45d9-911c-9a32a5e5120f" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:04:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:29 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:04:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:04:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:43 user nova-compute[74075]: INFO nova.compute.manager [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Terminating instance
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-e3b71b60-4c94-4587-b989-0c55b49a0c02 req-1465c17a-b81c-4a0f-858f-7668f8de1cac service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e3b71b60-4c94-4587-b989-0c55b49a0c02 req-1465c17a-b81c-4a0f-858f-7668f8de1cac service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e3b71b60-4c94-4587-b989-0c55b49a0c02 req-1465c17a-b81c-4a0f-858f-7668f8de1cac service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e3b71b60-4c94-4587-b989-0c55b49a0c02 req-1465c17a-b81c-4a0f-858f-7668f8de1cac service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-e3b71b60-4c94-4587-b989-0c55b49a0c02 req-1465c17a-b81c-4a0f-858f-7668f8de1cac service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-e3b71b60-4c94-4587-b989-0c55b49a0c02 req-1465c17a-b81c-4a0f-858f-7668f8de1cac service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-unplugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Instance destroyed successfully.
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lazy-loading 'resources' on Instance uuid 4bb3b8c4-0901-45d9-911c-9a32a5e5120f {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1164231499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1164231499',id=42,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOm5dLnc4DLkomJncO1LEgERtA1ZEa58+ZFXJLSZrGhnElxnicXpTmXJVjm9CJgvc1+2VA+DwAf6nhQEX1EzGgaLNhfcJpiDZxJ7fmhMiJ77giBpoPjjeQXL1LJmlf8FA==',key_name='tempest-keypair-692346324',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:03:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f38f50a5217486f935724fd94a0d419',ramdisk_id='',reservation_id='r-lyoezlvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-85318806',owner_user_name='tempest-AttachVolumeShelveTestJSON-85318806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c88b9df9bbd4d09adc2e1846fae72b2',uuid=4bb3b8c4-0901-45d9-911c-9a32a5e5120f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converting VIF {"id": "928f91c4-b734-41d3-8755-408ab6fcd218", "address": "fa:16:3e:d5:83:43", "network": {"id": "d4eb937c-6bac-48cd-965b-d067ee5cbc48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-23725356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f38f50a5217486f935724fd94a0d419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928f91c4-b7", "ovs_interfaceid": "928f91c4-b734-41d3-8755-408ab6fcd218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG os_vif [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap928f91c4-b7, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ceed7b7-3cf1-476e-b767-a89767720d70) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:43 user nova-compute[74075]: INFO os_vif [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:83:43,bridge_name='br-int',has_traffic_filtering=True,id=928f91c4-b734-41d3-8755-408ab6fcd218,network=Network(d4eb937c-6bac-48cd-965b-d067ee5cbc48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928f91c4-b7')
Oct 26 10:04:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Deleting instance files /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f_del
Oct 26 10:04:43 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Deletion of /opt/stack/data/nova/instances/4bb3b8c4-0901-45d9-911c-9a32a5e5120f_del complete
Oct 26 10:04:43 user nova-compute[74075]: INFO nova.compute.manager [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 10:04:43 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:04:43 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:04:44 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Took 0.69 seconds to deallocate network for instance.
Oct 26 10:04:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-dafed5dc-3e75-4ded-9781-0adc1beea11c req-68ba8751-d5d4-46bb-a737-79aabafce165 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-deleted-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:04:44 user nova-compute[74075]: INFO nova.compute.manager [req-dafed5dc-3e75-4ded-9781-0adc1beea11c req-68ba8751-d5d4-46bb-a737-79aabafce165 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Neutron deleted interface 928f91c4-b734-41d3-8755-408ab6fcd218; detaching it from the instance and deleting it from the info cache
Oct 26 10:04:44 user nova-compute[74075]: DEBUG nova.network.neutron [req-dafed5dc-3e75-4ded-9781-0adc1beea11c req-68ba8751-d5d4-46bb-a737-79aabafce165 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG nova.compute.manager [req-dafed5dc-3e75-4ded-9781-0adc1beea11c req-68ba8751-d5d4-46bb-a737-79aabafce165 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Detach interface failed, port_id=928f91c4-b734-41d3-8755-408ab6fcd218, reason: Instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:04:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:44 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Deleted allocations for instance 4bb3b8c4-0901-45d9-911c-9a32a5e5120f
Oct 26 10:04:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-6c60311d-1731-488b-bb27-abb35eaed06c tempest-AttachVolumeShelveTestJSON-85318806 tempest-AttachVolumeShelveTestJSON-85318806-project-member] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-ec47657f-d4c7-4310-8070-70d487d83e8c req-be92eaa4-bb53-4f07-8718-3b1ee27dc8b9 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:04:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ec47657f-d4c7-4310-8070-70d487d83e8c req-be92eaa4-bb53-4f07-8718-3b1ee27dc8b9 service nova] Acquiring lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:04:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ec47657f-d4c7-4310-8070-70d487d83e8c req-be92eaa4-bb53-4f07-8718-3b1ee27dc8b9 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:04:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-ec47657f-d4c7-4310-8070-70d487d83e8c req-be92eaa4-bb53-4f07-8718-3b1ee27dc8b9 service nova] Lock "4bb3b8c4-0901-45d9-911c-9a32a5e5120f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:04:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-ec47657f-d4c7-4310-8070-70d487d83e8c req-be92eaa4-bb53-4f07-8718-3b1ee27dc8b9 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] No waiting events found dispatching network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:04:45 user nova-compute[74075]: WARNING nova.compute.manager [req-ec47657f-d4c7-4310-8070-70d487d83e8c req-be92eaa4-bb53-4f07-8718-3b1ee27dc8b9 service nova] [instance: 4bb3b8c4-0901-45d9-911c-9a32a5e5120f] Received unexpected event network-vif-plugged-928f91c4-b734-41d3-8755-408ab6fcd218 for instance with vm_state deleted and task_state None.
Oct 26 10:04:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:04:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:04:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:04:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:04:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing instance network info cache due to event network-changed-74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] Acquiring lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] Acquired lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG nova.network.neutron [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Refreshing network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:00 user nova-compute[74075]: INFO nova.compute.manager [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Terminating instance
Oct 26 10:05:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updated VIF entry in instance network info cache for port 74b76b57-fa8b-44ca-bbc5-fad9304b899a. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [{"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-37338373-b95e-4d0f-839d-d7347f3f780f req-c950d5f9-f967-473a-9dbc-916431a94a39 service nova] Releasing lock "refresh_cache-f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-2c7f9ee3-4347-4075-a63e-0c53184e6eb6 req-1136954e-f24a-4049-b98c-df86577ee393 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-unplugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2c7f9ee3-4347-4075-a63e-0c53184e6eb6 req-1136954e-f24a-4049-b98c-df86577ee393 service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2c7f9ee3-4347-4075-a63e-0c53184e6eb6 req-1136954e-f24a-4049-b98c-df86577ee393 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2c7f9ee3-4347-4075-a63e-0c53184e6eb6 req-1136954e-f24a-4049-b98c-df86577ee393 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-2c7f9ee3-4347-4075-a63e-0c53184e6eb6 req-1136954e-f24a-4049-b98c-df86577ee393 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-unplugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-2c7f9ee3-4347-4075-a63e-0c53184e6eb6 req-1136954e-f24a-4049-b98c-df86577ee393 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-unplugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:05:01 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Instance destroyed successfully.
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lazy-loading 'resources' on Instance uuid f3d4e536-9aa0-45f5-9c9e-9883017ca2e8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T09:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1784053241',display_name='tempest-TestShelveInstance-server-1784053241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1784053241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKviCUwE0fDypWxHQvzZk865NjCxGGaszmr3hcRNQCq/y2hg6ZW6gJFoCkABszx5HPsSi2wNPyIF30HWzFOmMMhgYoi9S0DH7gRHlXhkSWZfvjpKiqehePOicqZSyH5/rA==',key_name='tempest-TestShelveInstance-791750146',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6ca57ef52fd4457b941d5b75c3fc2b0',ramdisk_id='',reservation_id='r-jup1ui7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1640843986',owner_user_name='tempest-TestShelveInstance-1640843986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:03:34Z,user_data=None,user_id='67e1f88d9a1344728a5dae45a143ca44',uuid=f3d4e536-9aa0-45f5-9c9e-9883017ca2e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converting VIF {"id": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "address": "fa:16:3e:90:d1:91", "network": {"id": "210035e7-2e82-4d82-ac13-74a302b3da52", "bridge": "br-int", "label": "tempest-TestShelveInstance-368105461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6ca57ef52fd4457b941d5b75c3fc2b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b76b57-fa", "ovs_interfaceid": "74b76b57-fa8b-44ca-bbc5-fad9304b899a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_vif [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74b76b57-fa, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a528661-fb87-40db-a703-6eb474ce99f9) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:01 user nova-compute[74075]: INFO os_vif [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:d1:91,bridge_name='br-int',has_traffic_filtering=True,id=74b76b57-fa8b-44ca-bbc5-fad9304b899a,network=Network(210035e7-2e82-4d82-ac13-74a302b3da52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b76b57-fa')
Oct 26 10:05:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhNuKAlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:05:01 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b4ffd-4202-4fb0-b9c3-1d3326d5b47d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:05:01 user nova-compute[74075]: No targets found.
Oct 26 10:05:01 user nova-compute[74075]: iSNS:
Oct 26 10:05:01 user nova-compute[74075]: No targets found.
Oct 26 10:05:01 user nova-compute[74075]: STATIC:
Oct 26 10:05:01 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99
Oct 26 10:05:01 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:05:01 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:05:01 user nova-compute[74075]: FIRMWARE:
Oct 26 10:05:01 user nova-compute[74075]: No targets found.
Oct 26 10:05:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:05:01 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:05:01 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df90e1d-f96d-4aae-b9b6-3f1575e58f98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c50f414-ddd6-40bb-987a-c8436bcb027f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 10:05:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 (non-flash)
Oct 26 10:05:01 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f466433c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b785a13d-4340-43ba-8eeb-3bf213c492f5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8234c3-5432-4a3c-90d7-72250c99d253]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc67b4c-cd58-4d23-b0ee-a674625a54c2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514edb8-adfc-4cef-a661-fcfb1b2af664]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9857c27-3e18-447b-8f90-3b459ba38201]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:05:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e950fe-7a20-411f-be77-7548bbf0e9e1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260]
Oct 26 10:05:02 user nova-compute[74075]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99, portal: 172.16.0.220,3260] successful.
Oct 26 10:05:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9574e0f-aaed-47ee-984c-edd8f84cdaa6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] <== disconnect_volume: return (298ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:05:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Deleting instance files /opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8_del
Oct 26 10:05:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Deletion of /opt/stack/data/nova/instances/f3d4e536-9aa0-45f5-9c9e-9883017ca2e8_del complete
Oct 26 10:05:02 user nova-compute[74075]: INFO nova.compute.manager [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 26 10:05:02 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:05:02 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:05:02 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Took 0.43 seconds to deallocate network for instance.
Oct 26 10:05:02 user nova-compute[74075]: DEBUG nova.compute.manager [req-8687bacc-ca27-493f-97e9-4e5dad531d24 req-3f78e40d-f373-4b27-9620-44c49f9527da service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-deleted-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:03 user nova-compute[74075]: INFO nova.compute.manager [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Took 0.81 seconds to detach 1 volumes for instance.
Oct 26 10:05:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Deleting volume: e35f3e2e-d1f8-44ee-a3ea-aa23dca73d99 {{(pid=74075) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:03 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Deleted allocations for instance f3d4e536-9aa0-45f5-9c9e-9883017ca2e8
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cc3f28a9-9b9d-431c-8f2f-e9f68f6e5da1 tempest-TestShelveInstance-1640843986 tempest-TestShelveInstance-1640843986-project-member] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-25f5e4a0-cb0d-4988-95aa-39235eb75569 req-e6586585-3bdd-4cd2-a50d-ec02b2b74059 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-25f5e4a0-cb0d-4988-95aa-39235eb75569 req-e6586585-3bdd-4cd2-a50d-ec02b2b74059 service nova] Acquiring lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-25f5e4a0-cb0d-4988-95aa-39235eb75569 req-e6586585-3bdd-4cd2-a50d-ec02b2b74059 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-25f5e4a0-cb0d-4988-95aa-39235eb75569 req-e6586585-3bdd-4cd2-a50d-ec02b2b74059 service nova] Lock "f3d4e536-9aa0-45f5-9c9e-9883017ca2e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-25f5e4a0-cb0d-4988-95aa-39235eb75569 req-e6586585-3bdd-4cd2-a50d-ec02b2b74059 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] No waiting events found dispatching network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:05:03 user nova-compute[74075]: WARNING nova.compute.manager [req-25f5e4a0-cb0d-4988-95aa-39235eb75569 req-e6586585-3bdd-4cd2-a50d-ec02b2b74059 service nova] [instance: f3d4e536-9aa0-45f5-9c9e-9883017ca2e8] Received unexpected event network-vif-plugged-74b76b57-fa8b-44ca-bbc5-fad9304b899a for instance with vm_state deleted and task_state None.
Oct 26 10:05:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:23 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:24 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:05:25 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:05:25 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=25.253253936767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:05:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:05:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:05:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:05:29 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:05:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:05:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:05:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:05:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:05:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:05:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:05:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:06:14 user nova-compute[74075]: INFO nova.compute.claims [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Claim successful on node user
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.network.neutron [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:06:14 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:06:14 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.policy [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb67037629e4020b1658abb0315331d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c319c3d30f475d8187e64d9a46ee52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:06:15 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Creating image(s)
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "/opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "/opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f,backing_fmt=raw /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk 1073741824" returned: 0 in 0.049s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.network.neutron [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Successfully created port: 6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Cannot resize image /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Ensure instance console log exists: /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:15 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Successfully updated port: 6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquired lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-changed-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.compute.manager [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Refreshing instance network info cache due to event network-changed-6f81843f-9d22-4988-aacd-3ae2c6405219. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] Acquiring lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updating instance_info_cache with network_info: [{"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Releasing lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Instance network_info: |[{"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] Acquired lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Refreshing network info cache for port 6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Start _get_guest_xml network_info=[{"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': 'dfb66725-6124-42bd-9a80-fc5728283531'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:06:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:06:16 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T09:20:11Z,direct_url=<?>,disk_format='qcow2',id=dfb66725-6124-42bd-9a80-fc5728283531,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1adb3b3dba104f3b992ef1a35bc02ec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T09:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1336623175',display_name='tempest-VolumesActionsTest-instance-1336623175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1336623175',id=44,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c319c3d30f475d8187e64d9a46ee52',ramdisk_id='',reservation_id='r-r556k84t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1320282938',owner_user_name='tempest-VolumesActionsTest-1320282938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:06:15Z,user_data=None,user_id='5bb67037629e4020b1658abb0315331d',uuid=cf4e48c0-b08d-44ac-89ef-b53018583685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Converting VIF {"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.objects.instance [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lazy-loading 'pci_devices' on Instance uuid cf4e48c0-b08d-44ac-89ef-b53018583685 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:06:16 user nova-compute[74075]:   <uuid>cf4e48c0-b08d-44ac-89ef-b53018583685</uuid>
Oct 26 10:06:16 user nova-compute[74075]:   <name>instance-0000002c</name>
Oct 26 10:06:16 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:06:16 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:06:16 user nova-compute[74075]:   <metadata>
Oct 26 10:06:16 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:06:16 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:06:16 user nova-compute[74075]:       <nova:name>tempest-VolumesActionsTest-instance-1336623175</nova:name>
Oct 26 10:06:16 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:06:16</nova:creationTime>
Oct 26 10:06:16 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:06:16 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:06:16 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:06:16 user nova-compute[74075]:       <nova:owner>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:user uuid="5bb67037629e4020b1658abb0315331d">tempest-VolumesActionsTest-1320282938-project-member</nova:user>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:project uuid="b5c319c3d30f475d8187e64d9a46ee52">tempest-VolumesActionsTest-1320282938</nova:project>
Oct 26 10:06:16 user nova-compute[74075]:       </nova:owner>
Oct 26 10:06:16 user nova-compute[74075]:       <nova:root type="image" uuid="dfb66725-6124-42bd-9a80-fc5728283531"/>
Oct 26 10:06:16 user nova-compute[74075]:       <nova:ports>
Oct 26 10:06:16 user nova-compute[74075]:         <nova:port uuid="6f81843f-9d22-4988-aacd-3ae2c6405219">
Oct 26 10:06:16 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 10:06:16 user nova-compute[74075]:         </nova:port>
Oct 26 10:06:16 user nova-compute[74075]:       </nova:ports>
Oct 26 10:06:16 user nova-compute[74075]:     </nova:instance>
Oct 26 10:06:16 user nova-compute[74075]:   </metadata>
Oct 26 10:06:16 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:06:16 user nova-compute[74075]:     <system>
Oct 26 10:06:16 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:06:16 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:06:16 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:06:16 user nova-compute[74075]:       <entry name="serial">cf4e48c0-b08d-44ac-89ef-b53018583685</entry>
Oct 26 10:06:16 user nova-compute[74075]:       <entry name="uuid">cf4e48c0-b08d-44ac-89ef-b53018583685</entry>
Oct 26 10:06:16 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:06:16 user nova-compute[74075]:     </system>
Oct 26 10:06:16 user nova-compute[74075]:   </sysinfo>
Oct 26 10:06:16 user nova-compute[74075]:   <os>
Oct 26 10:06:16 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:06:16 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:06:16 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:06:16 user nova-compute[74075]:   </os>
Oct 26 10:06:16 user nova-compute[74075]:   <features>
Oct 26 10:06:16 user nova-compute[74075]:     <acpi/>
Oct 26 10:06:16 user nova-compute[74075]:     <apic/>
Oct 26 10:06:16 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:06:16 user nova-compute[74075]:   </features>
Oct 26 10:06:16 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:06:16 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:06:16 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:06:16 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:06:16 user nova-compute[74075]:   </clock>
Oct 26 10:06:16 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:06:16 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:06:16 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:06:16 user nova-compute[74075]:   </cpu>
Oct 26 10:06:16 user nova-compute[74075]:   <devices>
Oct 26 10:06:16 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 10:06:16 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 10:06:16 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk"/>
Oct 26 10:06:16 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:06:16 user nova-compute[74075]:     </disk>
Oct 26 10:06:16 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:06:16 user nova-compute[74075]:       <mac address="fa:16:3e:0e:74:4d"/>
Oct 26 10:06:16 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:06:16 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:06:16 user nova-compute[74075]:       <target dev="tap6f81843f-9d"/>
Oct 26 10:06:16 user nova-compute[74075]:     </interface>
Oct 26 10:06:16 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:06:16 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/console.log" append="off"/>
Oct 26 10:06:16 user nova-compute[74075]:     </serial>
Oct 26 10:06:16 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:06:16 user nova-compute[74075]:     <video>
Oct 26 10:06:16 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:06:16 user nova-compute[74075]:     </video>
Oct 26 10:06:16 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:06:16 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:06:16 user nova-compute[74075]:     </rng>
Oct 26 10:06:16 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:06:16 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:06:16 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:06:16 user nova-compute[74075]:     </memballoon>
Oct 26 10:06:16 user nova-compute[74075]:   </devices>
Oct 26 10:06:16 user nova-compute[74075]: </domain>
Oct 26 10:06:16 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1336623175',display_name='tempest-VolumesActionsTest-instance-1336623175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1336623175',id=44,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c319c3d30f475d8187e64d9a46ee52',ramdisk_id='',reservation_id='r-r556k84t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1320282938',owner_user_name='tempest-VolumesActionsTest-1320282938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:06:15Z,user_data=None,user_id='5bb67037629e4020b1658abb0315331d',uuid=cf4e48c0-b08d-44ac-89ef-b53018583685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Converting VIF {"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG os_vif [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a080aa2f-4a99-51bf-a87a-70625d9a3fb4', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f81843f-9d, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f81843f-9d, col_values=(('qos', UUID('48159766-4bbe-4eaa-af36-83be09f483ba')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f81843f-9d, col_values=(('external_ids', {'iface-id': '6f81843f-9d22-4988-aacd-3ae2c6405219', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:74:4d', 'vm-uuid': 'cf4e48c0-b08d-44ac-89ef-b53018583685'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:16 user nova-compute[74075]: INFO os_vif [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d')
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] No VIF found with MAC fa:16:3e:0e:74:4d, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updated VIF entry in instance network info cache for port 6f81843f-9d22-4988-aacd-3ae2c6405219. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG nova.network.neutron [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updating instance_info_cache with network_info: [{"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:06:16 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-da8ca2b1-cb53-451e-8e93-244cf9f14b90 req-5f7583d8-5899-4203-8965-c3aa27db2722 service nova] Releasing lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:06:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-a22dbeb0-2292-4240-bf49-54fb36a1de29 req-b217e35e-f096-4942-bb5f-d58fd6c47b10 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a22dbeb0-2292-4240-bf49-54fb36a1de29 req-b217e35e-f096-4942-bb5f-d58fd6c47b10 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a22dbeb0-2292-4240-bf49-54fb36a1de29 req-b217e35e-f096-4942-bb5f-d58fd6c47b10 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a22dbeb0-2292-4240-bf49-54fb36a1de29 req-b217e35e-f096-4942-bb5f-d58fd6c47b10 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-a22dbeb0-2292-4240-bf49-54fb36a1de29 req-b217e35e-f096-4942-bb5f-d58fd6c47b10 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:06:18 user nova-compute[74075]: WARNING nova.compute.manager [req-a22dbeb0-2292-4240-bf49-54fb36a1de29 req-b217e35e-f096-4942-bb5f-d58fd6c47b10 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received unexpected event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with vm_state building and task_state spawning.
Oct 26 10:06:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:06:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:06:19 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Instance spawned successfully.
Oct 26 10:06:19 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:06:20 user nova-compute[74075]: INFO nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Took 5.00 seconds to spawn the instance on the hypervisor.
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:06:20 user nova-compute[74075]: INFO nova.compute.manager [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Took 5.54 seconds to build instance.
Oct 26 10:06:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-23650b69-11d2-4330-9b5b-8edc3cf064e2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.636s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-4bb25c9f-87ee-4b98-b930-a4712a97cd68 req-1a6e33bc-9fea-470e-bf5e-05d4472f97e0 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4bb25c9f-87ee-4b98-b930-a4712a97cd68 req-1a6e33bc-9fea-470e-bf5e-05d4472f97e0 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4bb25c9f-87ee-4b98-b930-a4712a97cd68 req-1a6e33bc-9fea-470e-bf5e-05d4472f97e0 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4bb25c9f-87ee-4b98-b930-a4712a97cd68 req-1a6e33bc-9fea-470e-bf5e-05d4472f97e0 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:20 user nova-compute[74075]: DEBUG nova.compute.manager [req-4bb25c9f-87ee-4b98-b930-a4712a97cd68 req-1a6e33bc-9fea-470e-bf5e-05d4472f97e0 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:06:20 user nova-compute[74075]: WARNING nova.compute.manager [req-4bb25c9f-87ee-4b98-b930-a4712a97cd68 req-1a6e33bc-9fea-470e-bf5e-05d4472f97e0 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received unexpected event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with vm_state active and task_state None.
Oct 26 10:06:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:24 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:24 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid cf4e48c0-b08d-44ac-89ef-b53018583685 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updating instance_info_cache with network_info: [{"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:06:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:06:27 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:06:27 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.241661071777344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance cf4e48c0-b08d-44ac-89ef-b53018583685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:06:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:06:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:06:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:06:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:06:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:07:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:07:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:07:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:07:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:07:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:26 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:07:26 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:07:26 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.213329315185547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:07:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance cf4e48c0-b08d-44ac-89ef-b53018583685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:07:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid cf4e48c0-b08d-44ac-89ef-b53018583685 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updating instance_info_cache with network_info: [{"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-cf4e48c0-b08d-44ac-89ef-b53018583685" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:07:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:07:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:07:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:07:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:07:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:07:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:07:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:07:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:07:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:07:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:07:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:08:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:08:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:08:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:08:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:08:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:08:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:08:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:08:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:08:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:21 user nova-compute[74075]: INFO nova.compute.manager [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Terminating instance
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.compute.manager [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1ed2a5e-6a46-4175-a215-bfbe31b9d454 req-84045193-1ccb-42fa-a7a1-f36f96ef2d39 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-unplugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1ed2a5e-6a46-4175-a215-bfbe31b9d454 req-84045193-1ccb-42fa-a7a1-f36f96ef2d39 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1ed2a5e-6a46-4175-a215-bfbe31b9d454 req-84045193-1ccb-42fa-a7a1-f36f96ef2d39 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e1ed2a5e-6a46-4175-a215-bfbe31b9d454 req-84045193-1ccb-42fa-a7a1-f36f96ef2d39 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1ed2a5e-6a46-4175-a215-bfbe31b9d454 req-84045193-1ccb-42fa-a7a1-f36f96ef2d39 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-unplugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.compute.manager [req-e1ed2a5e-6a46-4175-a215-bfbe31b9d454 req-84045193-1ccb-42fa-a7a1-f36f96ef2d39 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-unplugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Instance destroyed successfully.
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.objects.instance [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lazy-loading 'resources' on Instance uuid cf4e48c0-b08d-44ac-89ef-b53018583685 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1336623175',display_name='tempest-VolumesActionsTest-instance-1336623175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1336623175',id=44,image_ref='dfb66725-6124-42bd-9a80-fc5728283531',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c319c3d30f475d8187e64d9a46ee52',ramdisk_id='',reservation_id='r-r556k84t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dfb66725-6124-42bd-9a80-fc5728283531',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1320282938',owner_user_name='tempest-VolumesActionsTest-1320282938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:06:20Z,user_data=None,user_id='5bb67037629e4020b1658abb0315331d',uuid=cf4e48c0-b08d-44ac-89ef-b53018583685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Converting VIF {"id": "6f81843f-9d22-4988-aacd-3ae2c6405219", "address": "fa:16:3e:0e:74:4d", "network": {"id": "a9779c65-e5df-40d2-98b7-56f2f9d62050", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1201141564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c319c3d30f475d8187e64d9a46ee52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f81843f-9d", "ovs_interfaceid": "6f81843f-9d22-4988-aacd-3ae2c6405219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG os_vif [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f81843f-9d, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48159766-4bbe-4eaa-af36-83be09f483ba) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:08:21 user nova-compute[74075]: INFO os_vif [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=6f81843f-9d22-4988-aacd-3ae2c6405219,network=Network(a9779c65-e5df-40d2-98b7-56f2f9d62050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f81843f-9d')
Oct 26 10:08:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Deleting instance files /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685_del
Oct 26 10:08:21 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Deletion of /opt/stack/data/nova/instances/cf4e48c0-b08d-44ac-89ef-b53018583685_del complete
Oct 26 10:08:22 user nova-compute[74075]: INFO nova.compute.manager [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Took 0.72 seconds to destroy the instance on the hypervisor.
Oct 26 10:08:22 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:08:23 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Took 1.18 seconds to deallocate network for instance.
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:23 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Deleted allocations for instance cf4e48c0-b08d-44ac-89ef-b53018583685
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-27eb99d7-b8f6-4d32-a299-aedcd7a238d2 tempest-VolumesActionsTest-1320282938 tempest-VolumesActionsTest-1320282938-project-member] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:08:23 user nova-compute[74075]: WARNING nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received unexpected event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with vm_state deleted and task_state None.
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:08:23 user nova-compute[74075]: WARNING nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received unexpected event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with vm_state deleted and task_state None.
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:08:23 user nova-compute[74075]: WARNING nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received unexpected event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with vm_state deleted and task_state None.
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Acquiring lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] Lock "cf4e48c0-b08d-44ac-89ef-b53018583685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] No waiting events found dispatching network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:08:23 user nova-compute[74075]: WARNING nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received unexpected event network-vif-plugged-6f81843f-9d22-4988-aacd-3ae2c6405219 for instance with vm_state deleted and task_state None.
Oct 26 10:08:23 user nova-compute[74075]: DEBUG nova.compute.manager [req-20f7f702-6bfd-40dc-8984-be777d5e9bb9 req-e2c3706b-de7a-4900-8674-ccb1ce8c29b2 service nova] [instance: cf4e48c0-b08d-44ac-89ef-b53018583685] Received event network-vif-deleted-6f81843f-9d22-4988-aacd-3ae2c6405219 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:08:25 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:08:27 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:08:27 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.240219116210938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:08:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:08:29 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:08:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:08:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:08:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:08:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:08:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:08:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:09:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:09:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:09:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:09:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:09:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=25.239303588867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:09:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:09:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:09:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:09:31 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:09:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:09:36 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:09:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:09:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:09:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:09:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:10:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:10:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:27 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:10:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:10:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9125MB free_disk=25.237964630126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:10:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:10:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:10:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:10:32 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:10:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:10:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:10:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:10:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:10:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:10:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:10:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:10:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:10:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:10:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:10:59 user nova-compute[74075]: INFO nova.compute.claims [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Claim successful on node user
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:10:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.policy [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '169ffc3f50464bbebbf18c5fac1ecf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd7f3642ba49d597c0e6dc3ff354e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:10:59 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Creating image(s)
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "403d9959ddf9fe376b8582ea9f96b1eecdaf21eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:10:59 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "403d9959ddf9fe376b8582ea9f96b1eecdaf21eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Successfully created port: e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.virt.images [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] 12baa7ef-b6da-4b88-a4e6-8891bba09fac was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.part /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.part /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.converted" returned: 0 in 0.332s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Successfully updated port: e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "403d9959ddf9fe376b8582ea9f96b1eecdaf21eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.312s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.compute.manager [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing instance network info cache due to event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "403d9959ddf9fe376b8582ea9f96b1eecdaf21eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "403d9959ddf9fe376b8582ea9f96b1eecdaf21eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:00 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance network_info: |[{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb,backing_fmt=raw /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb,backing_fmt=raw /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk 1073741824" returned: 0 in 0.054s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "403d9959ddf9fe376b8582ea9f96b1eecdaf21eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated VIF entry in instance network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.neutron [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e346d00f-19e3-447a-aba3-50043ac960ce req-3171be0f-1a05-44b0-a382-30bfafe63cdc service nova] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Cannot resize image /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Ensure instance console log exists: /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Start _get_guest_xml network_info=[{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T10:10:56Z,direct_url=<?>,disk_format='qcow2',id=12baa7ef-b6da-4b88-a4e6-8891bba09fac,min_disk=0,min_ram=0,name='tempest-scenario-img--1148763616',owner='c3dd7f3642ba49d597c0e6dc3ff354e9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T10:10:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': '12baa7ef-b6da-4b88-a4e6-8891bba09fac'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:11:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:11:01 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T10:10:56Z,direct_url=<?>,disk_format='qcow2',id=12baa7ef-b6da-4b88-a4e6-8891bba09fac,min_disk=0,min_ram=0,name='tempest-scenario-img--1148763616',owner='c3dd7f3642ba49d597c0e6dc3ff354e9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T10:10:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991942774',display_name='tempest-TestMinimumBasicScenario-server-991942774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991942774',id=45,image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCP9tJVJpDZOB4KY9F9UyDmN1LfRnsYGWHtK8Imtf8hPXK9gN1qUygv2foBsD+rBZpBmgo2ypM3kB2H1xswe2LnTURLA0agh77gCtoJAY3zGj5pXK6bchTXI0LDNDoKPg==',key_name='tempest-TestMinimumBasicScenario-783878373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-vqgu122w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:10:59Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=b2274fb5-e766-4de2-b6ec-501addfbff7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'pci_devices' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:11:01 user nova-compute[74075]:   <uuid>b2274fb5-e766-4de2-b6ec-501addfbff7a</uuid>
Oct 26 10:11:01 user nova-compute[74075]:   <name>instance-0000002d</name>
Oct 26 10:11:01 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:11:01 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:11:01 user nova-compute[74075]:   <metadata>
Oct 26 10:11:01 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:11:01 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:11:01 user nova-compute[74075]:       <nova:name>tempest-TestMinimumBasicScenario-server-991942774</nova:name>
Oct 26 10:11:01 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:11:01</nova:creationTime>
Oct 26 10:11:01 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:11:01 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:11:01 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:11:01 user nova-compute[74075]:       <nova:owner>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:user uuid="169ffc3f50464bbebbf18c5fac1ecf52">tempest-TestMinimumBasicScenario-130688736-project-member</nova:user>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:project uuid="c3dd7f3642ba49d597c0e6dc3ff354e9">tempest-TestMinimumBasicScenario-130688736</nova:project>
Oct 26 10:11:01 user nova-compute[74075]:       </nova:owner>
Oct 26 10:11:01 user nova-compute[74075]:       <nova:root type="image" uuid="12baa7ef-b6da-4b88-a4e6-8891bba09fac"/>
Oct 26 10:11:01 user nova-compute[74075]:       <nova:ports>
Oct 26 10:11:01 user nova-compute[74075]:         <nova:port uuid="e8efb5f8-d8ca-4555-9515-4b36fdd6edc5">
Oct 26 10:11:01 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 10:11:01 user nova-compute[74075]:         </nova:port>
Oct 26 10:11:01 user nova-compute[74075]:       </nova:ports>
Oct 26 10:11:01 user nova-compute[74075]:     </nova:instance>
Oct 26 10:11:01 user nova-compute[74075]:   </metadata>
Oct 26 10:11:01 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:11:01 user nova-compute[74075]:     <system>
Oct 26 10:11:01 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:11:01 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:11:01 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:11:01 user nova-compute[74075]:       <entry name="serial">b2274fb5-e766-4de2-b6ec-501addfbff7a</entry>
Oct 26 10:11:01 user nova-compute[74075]:       <entry name="uuid">b2274fb5-e766-4de2-b6ec-501addfbff7a</entry>
Oct 26 10:11:01 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:11:01 user nova-compute[74075]:     </system>
Oct 26 10:11:01 user nova-compute[74075]:   </sysinfo>
Oct 26 10:11:01 user nova-compute[74075]:   <os>
Oct 26 10:11:01 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:11:01 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:11:01 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:11:01 user nova-compute[74075]:   </os>
Oct 26 10:11:01 user nova-compute[74075]:   <features>
Oct 26 10:11:01 user nova-compute[74075]:     <acpi/>
Oct 26 10:11:01 user nova-compute[74075]:     <apic/>
Oct 26 10:11:01 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:11:01 user nova-compute[74075]:   </features>
Oct 26 10:11:01 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:11:01 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:11:01 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:11:01 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:11:01 user nova-compute[74075]:   </clock>
Oct 26 10:11:01 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:11:01 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:11:01 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:11:01 user nova-compute[74075]:   </cpu>
Oct 26 10:11:01 user nova-compute[74075]:   <devices>
Oct 26 10:11:01 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 10:11:01 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 10:11:01 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk"/>
Oct 26 10:11:01 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:11:01 user nova-compute[74075]:     </disk>
Oct 26 10:11:01 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:11:01 user nova-compute[74075]:       <mac address="fa:16:3e:ee:bf:67"/>
Oct 26 10:11:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:11:01 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:11:01 user nova-compute[74075]:       <target dev="tape8efb5f8-d8"/>
Oct 26 10:11:01 user nova-compute[74075]:     </interface>
Oct 26 10:11:01 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:11:01 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/console.log" append="off"/>
Oct 26 10:11:01 user nova-compute[74075]:     </serial>
Oct 26 10:11:01 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:11:01 user nova-compute[74075]:     <video>
Oct 26 10:11:01 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:11:01 user nova-compute[74075]:     </video>
Oct 26 10:11:01 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:11:01 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:11:01 user nova-compute[74075]:     </rng>
Oct 26 10:11:01 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:11:01 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:11:01 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:11:01 user nova-compute[74075]:     </memballoon>
Oct 26 10:11:01 user nova-compute[74075]:   </devices>
Oct 26 10:11:01 user nova-compute[74075]: </domain>
Oct 26 10:11:01 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991942774',display_name='tempest-TestMinimumBasicScenario-server-991942774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991942774',id=45,image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCP9tJVJpDZOB4KY9F9UyDmN1LfRnsYGWHtK8Imtf8hPXK9gN1qUygv2foBsD+rBZpBmgo2ypM3kB2H1xswe2LnTURLA0agh77gCtoJAY3zGj5pXK6bchTXI0LDNDoKPg==',key_name='tempest-TestMinimumBasicScenario-783878373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-vqgu122w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:10:59Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=b2274fb5-e766-4de2-b6ec-501addfbff7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG os_vif [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a366c4c-d749-5e9f-a4c6-32bcaa7c9ddf', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8efb5f8-d8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8efb5f8-d8, col_values=(('qos', UUID('53867599-17be-4813-80c0-e0bbfdbc188b')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8efb5f8-d8, col_values=(('external_ids', {'iface-id': 'e8efb5f8-d8ca-4555-9515-4b36fdd6edc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:bf:67', 'vm-uuid': 'b2274fb5-e766-4de2-b6ec-501addfbff7a'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:01 user nova-compute[74075]: INFO os_vif [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8')
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:11:01 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No VIF found with MAC fa:16:3e:ee:bf:67, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:11:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-c1d733ef-ffd8-4e99-97f3-88642a7e51db req-04cb5c48-48a0-425d-a10a-d435344fee12 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1d733ef-ffd8-4e99-97f3-88642a7e51db req-04cb5c48-48a0-425d-a10a-d435344fee12 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1d733ef-ffd8-4e99-97f3-88642a7e51db req-04cb5c48-48a0-425d-a10a-d435344fee12 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-c1d733ef-ffd8-4e99-97f3-88642a7e51db req-04cb5c48-48a0-425d-a10a-d435344fee12 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG nova.compute.manager [req-c1d733ef-ffd8-4e99-97f3-88642a7e51db req-04cb5c48-48a0-425d-a10a-d435344fee12 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:11:03 user nova-compute[74075]: WARNING nova.compute.manager [req-c1d733ef-ffd8-4e99-97f3-88642a7e51db req-04cb5c48-48a0-425d-a10a-d435344fee12 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state building and task_state spawning.
Oct 26 10:11:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:11:05 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance spawned successfully.
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:11:05 user nova-compute[74075]: INFO nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:11:05 user nova-compute[74075]: INFO nova.compute.manager [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Took 6.23 seconds to build instance.
Oct 26 10:11:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-c4de7cf4-e111-4273-bc8d-9c8bdc2b44a9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.317s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ed6b658-950f-45b4-acab-beef9b2b51f6 req-d4072822-3164-43cb-a96a-d796766859aa service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ed6b658-950f-45b4-acab-beef9b2b51f6 req-d4072822-3164-43cb-a96a-d796766859aa service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ed6b658-950f-45b4-acab-beef9b2b51f6 req-d4072822-3164-43cb-a96a-d796766859aa service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-5ed6b658-950f-45b4-acab-beef9b2b51f6 req-d4072822-3164-43cb-a96a-d796766859aa service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:05 user nova-compute[74075]: DEBUG nova.compute.manager [req-5ed6b658-950f-45b4-acab-beef9b2b51f6 req-d4072822-3164-43cb-a96a-d796766859aa service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:11:05 user nova-compute[74075]: WARNING nova.compute.manager [req-5ed6b658-950f-45b4-acab-beef9b2b51f6 req-d4072822-3164-43cb-a96a-d796766859aa service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state active and task_state None.
Oct 26 10:11:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:28 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:11:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:11:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.146644592285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b2274fb5-e766-4de2-b6ec-501addfbff7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:11:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:11:33 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:11:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:11:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:11:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:11:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:11:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:11:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 10:11:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:11:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:11:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:11:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:11:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:12:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:29 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:12:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:12:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:12:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.145904541015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:12:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b2274fb5-e766-4de2-b6ec-501addfbff7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:12:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:12:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:12:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:12:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:12:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:12:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:12:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG nova.objects.instance [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'flavor' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:12:55 user nova-compute[74075]: INFO nova.compute.manager [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Attaching volume 64bf791c-00ee-492b-8583-23ca1d511417 to /dev/vdb
Oct 26 10:12:55 user nova-compute[74075]: DEBUG os_brick.utils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d774d9c-c0e8-4346-9254-d77a6aab62ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3836fc0-b48e-4852-9c9c-77c7cc60588f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b35ab-d7c4-4c58-9a84-cd3ad4cf90fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc314033-be59-46c1-b078-9baa99d92e18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:12:55 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:12:56 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:12:56 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e0967-0c49-426c-bba4-f52fde0749fb]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG os_brick.utils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:12:56 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating existing volume attachment record: 49c74aff-1bbc-4305-89da-9e333ff610e1 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:12:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:13:12 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:13:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:13:12 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:13:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:13:12 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:13:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f53ca9-3e9c-4de9-bc6b-dbc183783bcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:13:12 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:12 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed0b62-f64a-461b-8923-3d4dcacc9d5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417] added
Oct 26 10:13:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb6b32a-0cf9-44f7-a1b0-5366567ecfb9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b0f39-d987-40b2-8d54-f15ef3eb6d85]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEwLNGTq {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEwLNGTq" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c22a9b-cbc8-401a-9972-65f931fd665e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEwLNGTq'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a8748-578f-4f09-8e35-60399a68a85b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb08b42-23a8-4fb2-9ff5-fddd4e1d6391]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:13:13 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:13:13 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:13:13 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:13:13 user nova-compute[74075]: 
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[60114d52-bec3-4ff4-bf1b-a4e6d4845742]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]
Oct 26 10:13:13 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.
Oct 26 10:13:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124a2f3-dada-41ba-9c1d-7e75b58dfb8b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aecf5b-6215-4fbb-8fab-b997f983f9c1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:13:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:13:13 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[055b011f-e5b3-4b9f-9c45-cce02ee0baa2]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:13:13 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26230376634323238', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230376634323238', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG nova.objects.instance [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'flavor' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 10:13:14 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:13:14 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 10:13:14 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 10:13:14 user nova-compute[74075]:   <serial>64bf791c-00ee-492b-8583-23ca1d511417</serial>
Oct 26 10:13:14 user nova-compute[74075]: </disk>
Oct 26 10:13:14 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No VIF found with MAC fa:16:3e:ee:bf:67, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:13:14 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-930cc411-1d71-4f75-9b1c-bf6ec851b9cb tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.936s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing instance network info cache due to event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated VIF entry in instance network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:13:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6f3861f4-7b06-4525-b1d9-e95ec3f26ea6 req-c2cf048e-57bc-4b70-a434-435f52d77771 service nova] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:13:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:13:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing instance network info cache due to event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:13:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:13:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:13:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:13:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated VIF entry in instance network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:13:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:13:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-dbbf3c3b-f8af-4146-a96b-8dff75b625f4 req-7327b8d2-9c31-41be-b11e-5be5b6fd0bca service nova] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:13:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:13:31 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:13:31 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.136722564697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b2274fb5-e766-4de2-b6ec-501addfbff7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:13:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:33 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:13:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:13:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:13:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:39 user nova-compute[74075]: INFO nova.compute.manager [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Rebooting instance
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-679ca406-095e-426a-a35f-925bddf4a610 req-643657f9-2a07-4bd9-9cba-516aa1844ba0 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-unplugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-679ca406-095e-426a-a35f-925bddf4a610 req-643657f9-2a07-4bd9-9cba-516aa1844ba0 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-679ca406-095e-426a-a35f-925bddf4a610 req-643657f9-2a07-4bd9-9cba-516aa1844ba0 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-679ca406-095e-426a-a35f-925bddf4a610 req-643657f9-2a07-4bd9-9cba-516aa1844ba0 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-679ca406-095e-426a-a35f-925bddf4a610 req-643657f9-2a07-4bd9-9cba-516aa1844ba0 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-unplugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:13:40 user nova-compute[74075]: WARNING nova.compute.manager [req-679ca406-095e-426a-a35f-925bddf4a610 req-643657f9-2a07-4bd9-9cba-516aa1844ba0 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-unplugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 10:13:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance destroyed successfully.
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'resources' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991942774',display_name='tempest-TestMinimumBasicScenario-server-991942774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991942774',id=45,image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCP9tJVJpDZOB4KY9F9UyDmN1LfRnsYGWHtK8Imtf8hPXK9gN1qUygv2foBsD+rBZpBmgo2ypM3kB2H1xswe2LnTURLA0agh77gCtoJAY3zGj5pXK6bchTXI0LDNDoKPg==',key_name='tempest-TestMinimumBasicScenario-783878373',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-vqgu122w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:13:40Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=b2274fb5-e766-4de2-b6ec-501addfbff7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8efb5f8-d8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53867599-17be-4813-80c0-e0bbfdbc188b) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:41 user nova-compute[74075]: INFO os_vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8')
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:13:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4b678-853a-4391-9539-f12119ce7fb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:13:41 user nova-compute[74075]: No targets found.
Oct 26 10:13:41 user nova-compute[74075]: iSNS:
Oct 26 10:13:41 user nova-compute[74075]: No targets found.
Oct 26 10:13:41 user nova-compute[74075]: STATIC:
Oct 26 10:13:41 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417
Oct 26 10:13:41 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:13:41 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:13:41 user nova-compute[74075]: FIRMWARE:
Oct 26 10:13:41 user nova-compute[74075]: No targets found.
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:13:41 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:13:41 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d243a374-2d1d-4dcf-bb93-73f10956dcb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[898bdb8f-e542-4316-aa97-73b8b7cffa03]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f466418c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eb66f9-fdbe-4d19-851e-82f6ad5c49ea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[77462172-cdc4-46ac-b9f0-1615f13009c3]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f7fe6-5a48-481b-97e0-536abdc0d301]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ebd22-e604-426d-96ee-03af5a494831]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327d9e8-3769-4a53-a57e-e867b5bb2eee]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ae016-abce-429a-9d30-d5d5af5aeed2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]
Oct 26 10:13:41 user nova-compute[74075]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de42a4a-ecbb-485c-879d-70716ef5a5fe]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== disconnect_volume: return (319ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Start _get_guest_xml network_info=[{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=12baa7ef-b6da-4b88-a4e6-8891bba09fac,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': '12baa7ef-b6da-4b88-a4e6-8891bba09fac'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '49c74aff-1bbc-4305-89da-9e333ff610e1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b2274fb5-e766-4de2-b6ec-501addfbff7a', 'attached_at': '', 'detached_at': '', 'volume_id': '64bf791c-00ee-492b-8583-23ca1d511417', 'serial': '64bf791c-00ee-492b-8583-23ca1d511417'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:13:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:13:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=12baa7ef-b6da-4b88-a4e6-8891bba09fac,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.objects.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Object Instance<b2274fb5-e766-4de2-b6ec-501addfbff7a> lazy-loaded attributes: resources,vcpu_model {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:13:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:13:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:13:41 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ae140-5eb5-449f-8d03-7e6d30885c19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:13:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f590b4-4e2f-468d-afb8-06158254f58b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417] added
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[60398c75-6c0d-421d-b5c2-941c304cc9e9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a7c610-fcf7-43ff-b728-6e37775f3656]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEwLNGTq {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEwLNGTq" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a571f567-6b01-4394-b778-78ca6c5f0a53]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEwLNGTq'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f96ea-280b-4c1f-8347-550226290e1c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ae3f79-2a2d-44b1-b48f-3c48b07e0e99]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:13:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:13:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:13:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:13:41 user nova-compute[74075]: 
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[05217f1a-6ac0-4ad7-8046-97063e2f71eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]
Oct 26 10:13:41 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5181938-4ae4-491e-ac0e-81d03af114ae]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a354b3d-e803-4c0d-b864-41df3a73c48b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:13:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de5d76-ef47-4b04-8d26-d0ed5399b3f0]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:13:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-95ad122e-0be7-4185-a64b-80f8551bb95f req-681b9a86-1f7f-4530-8c99-7dcb6ca6ab92 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95ad122e-0be7-4185-a64b-80f8551bb95f req-681b9a86-1f7f-4530-8c99-7dcb6ca6ab92 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95ad122e-0be7-4185-a64b-80f8551bb95f req-681b9a86-1f7f-4530-8c99-7dcb6ca6ab92 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-95ad122e-0be7-4185-a64b-80f8551bb95f req-681b9a86-1f7f-4530-8c99-7dcb6ca6ab92 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-95ad122e-0be7-4185-a64b-80f8551bb95f req-681b9a86-1f7f-4530-8c99-7dcb6ca6ab92 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:13:42 user nova-compute[74075]: WARNING nova.compute.manager [req-95ad122e-0be7-4185-a64b-80f8551bb95f req-681b9a86-1f7f-4530-8c99-7dcb6ca6ab92 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 10:13:42 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26230376634323238', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:13:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230376634323238', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991942774',display_name='tempest-TestMinimumBasicScenario-server-991942774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991942774',id=45,image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCP9tJVJpDZOB4KY9F9UyDmN1LfRnsYGWHtK8Imtf8hPXK9gN1qUygv2foBsD+rBZpBmgo2ypM3kB2H1xswe2LnTURLA0agh77gCtoJAY3zGj5pXK6bchTXI0LDNDoKPg==',key_name='tempest-TestMinimumBasicScenario-783878373',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-vqgu122w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:13:40Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=b2274fb5-e766-4de2-b6ec-501addfbff7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'pci_devices' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.objects.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Object Instance<b2274fb5-e766-4de2-b6ec-501addfbff7a> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:13:43 user nova-compute[74075]:   <uuid>b2274fb5-e766-4de2-b6ec-501addfbff7a</uuid>
Oct 26 10:13:43 user nova-compute[74075]:   <name>instance-0000002d</name>
Oct 26 10:13:43 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:13:43 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:13:43 user nova-compute[74075]:   <metadata>
Oct 26 10:13:43 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:13:43 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:13:43 user nova-compute[74075]:       <nova:name>tempest-TestMinimumBasicScenario-server-991942774</nova:name>
Oct 26 10:13:43 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:13:41</nova:creationTime>
Oct 26 10:13:43 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:13:43 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:13:43 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:13:43 user nova-compute[74075]:       <nova:owner>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:user uuid="169ffc3f50464bbebbf18c5fac1ecf52">tempest-TestMinimumBasicScenario-130688736-project-member</nova:user>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:project uuid="c3dd7f3642ba49d597c0e6dc3ff354e9">tempest-TestMinimumBasicScenario-130688736</nova:project>
Oct 26 10:13:43 user nova-compute[74075]:       </nova:owner>
Oct 26 10:13:43 user nova-compute[74075]:       <nova:root type="image" uuid="12baa7ef-b6da-4b88-a4e6-8891bba09fac"/>
Oct 26 10:13:43 user nova-compute[74075]:       <nova:ports>
Oct 26 10:13:43 user nova-compute[74075]:         <nova:port uuid="e8efb5f8-d8ca-4555-9515-4b36fdd6edc5">
Oct 26 10:13:43 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 10:13:43 user nova-compute[74075]:         </nova:port>
Oct 26 10:13:43 user nova-compute[74075]:       </nova:ports>
Oct 26 10:13:43 user nova-compute[74075]:     </nova:instance>
Oct 26 10:13:43 user nova-compute[74075]:   </metadata>
Oct 26 10:13:43 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:13:43 user nova-compute[74075]:     <system>
Oct 26 10:13:43 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:13:43 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:13:43 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:13:43 user nova-compute[74075]:       <entry name="serial">b2274fb5-e766-4de2-b6ec-501addfbff7a</entry>
Oct 26 10:13:43 user nova-compute[74075]:       <entry name="uuid">b2274fb5-e766-4de2-b6ec-501addfbff7a</entry>
Oct 26 10:13:43 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:13:43 user nova-compute[74075]:     </system>
Oct 26 10:13:43 user nova-compute[74075]:   </sysinfo>
Oct 26 10:13:43 user nova-compute[74075]:   <os>
Oct 26 10:13:43 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:13:43 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:13:43 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:13:43 user nova-compute[74075]:   </os>
Oct 26 10:13:43 user nova-compute[74075]:   <features>
Oct 26 10:13:43 user nova-compute[74075]:     <acpi/>
Oct 26 10:13:43 user nova-compute[74075]:     <apic/>
Oct 26 10:13:43 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:13:43 user nova-compute[74075]:   </features>
Oct 26 10:13:43 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:13:43 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:13:43 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:13:43 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:13:43 user nova-compute[74075]:   </clock>
Oct 26 10:13:43 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:13:43 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:13:43 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:13:43 user nova-compute[74075]:   </cpu>
Oct 26 10:13:43 user nova-compute[74075]:   <devices>
Oct 26 10:13:43 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 10:13:43 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 10:13:43 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk"/>
Oct 26 10:13:43 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:13:43 user nova-compute[74075]:     </disk>
Oct 26 10:13:43 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:13:43 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:13:43 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 10:13:43 user nova-compute[74075]:       <target dev="vdb" bus="virtio"/>
Oct 26 10:13:43 user nova-compute[74075]:       <serial>64bf791c-00ee-492b-8583-23ca1d511417</serial>
Oct 26 10:13:43 user nova-compute[74075]:     </disk>
Oct 26 10:13:43 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:13:43 user nova-compute[74075]:       <mac address="fa:16:3e:ee:bf:67"/>
Oct 26 10:13:43 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:13:43 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:13:43 user nova-compute[74075]:       <target dev="tape8efb5f8-d8"/>
Oct 26 10:13:43 user nova-compute[74075]:     </interface>
Oct 26 10:13:43 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:13:43 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/console.log" append="off"/>
Oct 26 10:13:43 user nova-compute[74075]:     </serial>
Oct 26 10:13:43 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:13:43 user nova-compute[74075]:     <video>
Oct 26 10:13:43 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:13:43 user nova-compute[74075]:     </video>
Oct 26 10:13:43 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:13:43 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:13:43 user nova-compute[74075]:     </rng>
Oct 26 10:13:43 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:13:43 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:13:43 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:13:43 user nova-compute[74075]:     </memballoon>
Oct 26 10:13:43 user nova-compute[74075]:   </devices>
Oct 26 10:13:43 user nova-compute[74075]: </domain>
Oct 26 10:13:43 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.objects.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Object Instance<b2274fb5-e766-4de2-b6ec-501addfbff7a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb --force-share --output=json" returned: 0 in 0.170s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Cannot resize image /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'migration_context' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.objects.base [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Object Instance<b2274fb5-e766-4de2-b6ec-501addfbff7a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74075) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991942774',display_name='tempest-TestMinimumBasicScenario-server-991942774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991942774',id=45,image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCP9tJVJpDZOB4KY9F9UyDmN1LfRnsYGWHtK8Imtf8hPXK9gN1qUygv2foBsD+rBZpBmgo2ypM3kB2H1xswe2LnTURLA0agh77gCtoJAY3zGj5pXK6bchTXI0LDNDoKPg==',key_name='tempest-TestMinimumBasicScenario-783878373',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-vqgu122w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:13:40Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=b2274fb5-e766-4de2-b6ec-501addfbff7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG os_vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a366c4c-d749-5e9f-a4c6-32bcaa7c9ddf', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8efb5f8-d8, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8efb5f8-d8, col_values=(('qos', UUID('0f0d2275-dc05-40c5-8353-3a0caaf5fad5')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8efb5f8-d8, col_values=(('external_ids', {'iface-id': 'e8efb5f8-d8ca-4555-9515-4b36fdd6edc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:bf:67', 'vm-uuid': 'b2274fb5-e766-4de2-b6ec-501addfbff7a'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:43 user nova-compute[74075]: INFO os_vif [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8')
Oct 26 10:13:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a7c7b7f-3340-4a99-81b6-15344f23b620 req-b755edbd-dcd0-4e28-a08e-b243b187c9e5 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a7c7b7f-3340-4a99-81b6-15344f23b620 req-b755edbd-dcd0-4e28-a08e-b243b187c9e5 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a7c7b7f-3340-4a99-81b6-15344f23b620 req-b755edbd-dcd0-4e28-a08e-b243b187c9e5 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a7c7b7f-3340-4a99-81b6-15344f23b620 req-b755edbd-dcd0-4e28-a08e-b243b187c9e5 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a7c7b7f-3340-4a99-81b6-15344f23b620 req-b755edbd-dcd0-4e28-a08e-b243b187c9e5 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:13:45 user nova-compute[74075]: WARNING nova.compute.manager [req-3a7c7b7f-3340-4a99-81b6-15344f23b620 req-b755edbd-dcd0-4e28-a08e-b243b187c9e5 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 10:13:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:13:47 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance rebooted successfully.
Oct 26 10:13:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:13:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24fcec6f-0453-43d0-8de5-38dadc274280 req-ca1c3141-472c-43a9-a395-1c25f4c463c9 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:13:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24fcec6f-0453-43d0-8de5-38dadc274280 req-ca1c3141-472c-43a9-a395-1c25f4c463c9 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:13:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24fcec6f-0453-43d0-8de5-38dadc274280 req-ca1c3141-472c-43a9-a395-1c25f4c463c9 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:13:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-24fcec6f-0453-43d0-8de5-38dadc274280 req-ca1c3141-472c-43a9-a395-1c25f4c463c9 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-24fcec6f-0453-43d0-8de5-38dadc274280 req-ca1c3141-472c-43a9-a395-1c25f4c463c9 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:13:47 user nova-compute[74075]: WARNING nova.compute.manager [req-24fcec6f-0453-43d0-8de5-38dadc274280 req-ca1c3141-472c-43a9-a395-1c25f4c463c9 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 10:13:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-38930964-8c94-4f71-b4e1-ed8a411635f0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.470s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:13:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:13:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:13:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:13:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:13:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:13:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:14:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:14:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:14:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:14:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:14:32 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:14:32 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:14:32 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.135047912597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:14:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b2274fb5-e766-4de2-b6ec-501addfbff7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:14:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:14:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:14:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:14:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:14:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:14:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:14:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:14:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing instance network info cache due to event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG nova.network.neutron [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG nova.network.neutron [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated VIF entry in instance network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG nova.network.neutron [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:15:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-866147d7-026f-4ef1-8ec6-900d29ce4c42 req-6da60c2d-d78e-42c7-ad05-73d0c9356fb7 service nova] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:15:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:15:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:15:33 user nova-compute[74075]: INFO nova.compute.manager [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Detaching volume 64bf791c-00ee-492b-8583-23ca1d511417
Oct 26 10:15:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:33 user nova-compute[74075]: INFO nova.virt.block_device [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Attempting to driver detach volume 64bf791c-00ee-492b-8583-23ca1d511417 from mountpoint /dev/vdb
Oct 26 10:15:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Attempting to detach device vdb from instance b2274fb5-e766-4de2-b6ec-501addfbff7a from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 10:15:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 10:15:33 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:15:33 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 10:15:33 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 10:15:33 user nova-compute[74075]:   <serial>64bf791c-00ee-492b-8583-23ca1d511417</serial>
Oct 26 10:15:33 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 10:15:33 user nova-compute[74075]: </disk>
Oct 26 10:15:33 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 10:15:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully detached device vdb from instance b2274fb5-e766-4de2-b6ec-501addfbff7a from the persistent domain config.
Oct 26 10:15:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2274fb5-e766-4de2-b6ec-501addfbff7a from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 10:15:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 10:15:33 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:15:33 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 10:15:33 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 10:15:33 user nova-compute[74075]:   <serial>64bf791c-00ee-492b-8583-23ca1d511417</serial>
Oct 26 10:15:33 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 10:15:33 user nova-compute[74075]: </disk>
Oct 26 10:15:33 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 10:15:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 10:15:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing instance network info cache due to event network-changed-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Refreshing network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated VIF entry in instance network info cache for port e8efb5f8-d8ca-4555-9515-4b36fdd6edc5. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-69cbfe5c-6741-40ef-b000-0180733088f4 req-e53d26f0-336b-43e6-9465-4ef228598cb6 service nova] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:34 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:15:34 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:15:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.134357452392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:15:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b2274fb5-e766-4de2-b6ec-501addfbff7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:15:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:15:36 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:36 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:15:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [{"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b2274fb5-e766-4de2-b6ec-501addfbff7a" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:15:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:15:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2274fb5-e766-4de2-b6ec-501addfbff7a is timed out.
Oct 26 10:15:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully detached device vdb from instance b2274fb5-e766-4de2-b6ec-501addfbff7a from the live domain config.
Oct 26 10:15:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEwLNGTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:15:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a5282d-be26-4bda-a0d6-be2aafb6d26c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:15:53 user nova-compute[74075]: No targets found.
Oct 26 10:15:53 user nova-compute[74075]: iSNS:
Oct 26 10:15:53 user nova-compute[74075]: No targets found.
Oct 26 10:15:53 user nova-compute[74075]: STATIC:
Oct 26 10:15:53 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417
Oct 26 10:15:53 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:15:53 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:15:53 user nova-compute[74075]: FIRMWARE:
Oct 26 10:15:53 user nova-compute[74075]: No targets found.
Oct 26 10:15:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:15:53 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:15:53 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a5156-6008-43d8-b3d5-df399dfd69b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2260274d-246a-47f5-b1e4-48f3dae019a2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:15:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 (non-flash)
Oct 26 10:15:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c281900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b36dd9-4750-4ded-87ad-344a04e047bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa88be2-4995-4841-a522-8060d90853a3]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f3ebc-e2c7-4d4f-9f76-e0caeb3cfa94]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d099276-604a-48f2-b6fa-63324a4b7a7d]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cddbaf-e75f-4ddb-942d-8211a036bf2c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:15:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387858b-1680-4ebf-b957-9a347f39d785]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260]
Oct 26 10:15:54 user nova-compute[74075]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417, portal: 172.16.0.220,3260] successful.
Oct 26 10:15:54 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bf791c-00ee-492b-8583-23ca1d511417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53428f33-33c8-4a50-bd2a-5a1482665435]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== disconnect_volume: return (290ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG nova.objects.instance [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'flavor' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:15:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-568d0314-5d4a-44a4-9a1b-bfcb728ffdf0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:15:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:15:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:15:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:15:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:15:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:15:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:16:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:16:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:16:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:16:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:16:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:16:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:16:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:16:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:16:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:33 user nova-compute[74075]: INFO nova.compute.manager [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Terminating instance
Oct 26 10:16:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-6832b8f7-40fc-49ea-95d2-02abf506a6fb req-ff1e7b27-3cab-46ab-a7da-2d0821fa0e46 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-unplugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6832b8f7-40fc-49ea-95d2-02abf506a6fb req-ff1e7b27-3cab-46ab-a7da-2d0821fa0e46 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6832b8f7-40fc-49ea-95d2-02abf506a6fb req-ff1e7b27-3cab-46ab-a7da-2d0821fa0e46 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6832b8f7-40fc-49ea-95d2-02abf506a6fb req-ff1e7b27-3cab-46ab-a7da-2d0821fa0e46 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-6832b8f7-40fc-49ea-95d2-02abf506a6fb req-ff1e7b27-3cab-46ab-a7da-2d0821fa0e46 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-unplugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-6832b8f7-40fc-49ea-95d2-02abf506a6fb req-ff1e7b27-3cab-46ab-a7da-2d0821fa0e46 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-unplugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Instance destroyed successfully.
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.objects.instance [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'resources' on Instance uuid b2274fb5-e766-4de2-b6ec-501addfbff7a {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991942774',display_name='tempest-TestMinimumBasicScenario-server-991942774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991942774',id=45,image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCP9tJVJpDZOB4KY9F9UyDmN1LfRnsYGWHtK8Imtf8hPXK9gN1qUygv2foBsD+rBZpBmgo2ypM3kB2H1xswe2LnTURLA0agh77gCtoJAY3zGj5pXK6bchTXI0LDNDoKPg==',key_name='tempest-TestMinimumBasicScenario-783878373',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-vqgu122w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='12baa7ef-b6da-4b88-a4e6-8891bba09fac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:13:47Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=b2274fb5-e766-4de2-b6ec-501addfbff7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "address": "fa:16:3e:ee:bf:67", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8efb5f8-d8", "ovs_interfaceid": "e8efb5f8-d8ca-4555-9515-4b36fdd6edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG os_vif [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8efb5f8-d8, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f0d2275-dc05-40c5-8353-3a0caaf5fad5) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:34 user nova-compute[74075]: INFO os_vif [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8efb5f8-d8')
Oct 26 10:16:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Deleting instance files /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a_del
Oct 26 10:16:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Deletion of /opt/stack/data/nova/instances/b2274fb5-e766-4de2-b6ec-501addfbff7a_del complete
Oct 26 10:16:34 user nova-compute[74075]: INFO nova.compute.manager [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:16:34 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:16:34 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=25.16173553466797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b2274fb5-e766-4de2-b6ec-501addfbff7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:16:34 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Took 0.84 seconds to deallocate network for instance.
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.compute.manager [req-a9783cff-ae78-4098-95af-9fcc57922d5f req-c56849bf-f6e6-47ca-8f44-3dd5bae0c687 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-deleted-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:16:34 user nova-compute[74075]: INFO nova.compute.manager [req-a9783cff-ae78-4098-95af-9fcc57922d5f req-c56849bf-f6e6-47ca-8f44-3dd5bae0c687 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Neutron deleted interface e8efb5f8-d8ca-4555-9515-4b36fdd6edc5; detaching it from the instance and deleting it from the info cache
Oct 26 10:16:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-a9783cff-ae78-4098-95af-9fcc57922d5f req-c56849bf-f6e6-47ca-8f44-3dd5bae0c687 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-a9783cff-ae78-4098-95af-9fcc57922d5f req-c56849bf-f6e6-47ca-8f44-3dd5bae0c687 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Detach interface failed, port_id=e8efb5f8-d8ca-4555-9515-4b36fdd6edc5, reason: Instance b2274fb5-e766-4de2-b6ec-501addfbff7a could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:35 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Deleted allocations for instance b2274fb5-e766-4de2-b6ec-501addfbff7a
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-b426a7ea-4df5-4ce5-b12e-d0e0c15bb4b9 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-a1d8bf0b-ed7c-49d6-941d-6eda1b4ef64d req-b6fa11e7-340b-459e-8e78-a7e17fb99264 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a1d8bf0b-ed7c-49d6-941d-6eda1b4ef64d req-b6fa11e7-340b-459e-8e78-a7e17fb99264 service nova] Acquiring lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a1d8bf0b-ed7c-49d6-941d-6eda1b4ef64d req-b6fa11e7-340b-459e-8e78-a7e17fb99264 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a1d8bf0b-ed7c-49d6-941d-6eda1b4ef64d req-b6fa11e7-340b-459e-8e78-a7e17fb99264 service nova] Lock "b2274fb5-e766-4de2-b6ec-501addfbff7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:16:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-a1d8bf0b-ed7c-49d6-941d-6eda1b4ef64d req-b6fa11e7-340b-459e-8e78-a7e17fb99264 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] No waiting events found dispatching network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:16:35 user nova-compute[74075]: WARNING nova.compute.manager [req-a1d8bf0b-ed7c-49d6-941d-6eda1b4ef64d req-b6fa11e7-340b-459e-8e78-a7e17fb99264 service nova] [instance: b2274fb5-e766-4de2-b6ec-501addfbff7a] Received unexpected event network-vif-plugged-e8efb5f8-d8ca-4555-9515-4b36fdd6edc5 for instance with vm_state deleted and task_state None.
Oct 26 10:16:36 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:37 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:16:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:16:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:16:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:16:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:16:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:16:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:16:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:17:27 user nova-compute[74075]: INFO nova.compute.claims [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Claim successful on node user
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:17:27 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.policy [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '169ffc3f50464bbebbf18c5fac1ecf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3dd7f3642ba49d597c0e6dc3ff354e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:17:27 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Creating image(s)
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "/opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "/opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.part --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Successfully created port: fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG nova.virt.images [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] 34f1281b-f0e8-4161-a772-b9c94532af18 was qcow2, converting to raw {{(pid=74075) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG nova.privsep.utils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74075) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.part /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.converted {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.part /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.converted" returned: 0 in 0.259s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.converted --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.027s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 --force-share --output=json" returned: 0 in 0.169s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Successfully updated port: fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing instance network info cache due to event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32,backing_fmt=raw /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk 1073741824 {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32,backing_fmt=raw /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk 1073741824" returned: 0 in 0.050s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 --force-share --output=json" returned: 0 in 0.167s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk. size=1073741824 {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.neutron [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance network_info: |[{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.disk.api [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Cannot resize image /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk to a smaller size. {{(pid=74075) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Created local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Ensure instance console log exists: /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Start _get_guest_xml network_info=[{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T10:17:24Z,direct_url=<?>,disk_format='qcow2',id=34f1281b-f0e8-4161-a772-b9c94532af18,min_disk=0,min_ram=0,name='tempest-scenario-img--1847259378',owner='c3dd7f3642ba49d597c0e6dc3ff354e9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T10:17:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'image_id': '34f1281b-f0e8-4161-a772-b9c94532af18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:17:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:17:29 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T10:17:24Z,direct_url=<?>,disk_format='qcow2',id=34f1281b-f0e8-4161-a772-b9c94532af18,min_disk=0,min_ram=0,name='tempest-scenario-img--1847259378',owner='c3dd7f3642ba49d597c0e6dc3ff354e9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T10:17:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-452002464',display_name='tempest-TestMinimumBasicScenario-server-452002464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-452002464',id=46,image_ref='34f1281b-f0e8-4161-a772-b9c94532af18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLHp3LOpPympJXp8ElLdHTxNtg+gcmfoG2hn69PrO+mwppfB/+J8F8fMHMPdO9rn9M2xPazLifK4vtYAT3RsiEal+JZb5nMXe9Byx77HMDkIbfggr5yP+xRU9xPhwaofA==',key_name='tempest-TestMinimumBasicScenario-1896356415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-sb0mud32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34f1281b-f0e8-4161-a772-b9c94532af18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:17:28Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=a6cf9f16-8c14-4275-9baa-51e144c52c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.objects.instance [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'pci_devices' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:17:29 user nova-compute[74075]:   <uuid>a6cf9f16-8c14-4275-9baa-51e144c52c28</uuid>
Oct 26 10:17:29 user nova-compute[74075]:   <name>instance-0000002e</name>
Oct 26 10:17:29 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:17:29 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:17:29 user nova-compute[74075]:   <metadata>
Oct 26 10:17:29 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:17:29 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:17:29 user nova-compute[74075]:       <nova:name>tempest-TestMinimumBasicScenario-server-452002464</nova:name>
Oct 26 10:17:29 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:17:29</nova:creationTime>
Oct 26 10:17:29 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:17:29 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:17:29 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:17:29 user nova-compute[74075]:       <nova:owner>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:user uuid="169ffc3f50464bbebbf18c5fac1ecf52">tempest-TestMinimumBasicScenario-130688736-project-member</nova:user>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:project uuid="c3dd7f3642ba49d597c0e6dc3ff354e9">tempest-TestMinimumBasicScenario-130688736</nova:project>
Oct 26 10:17:29 user nova-compute[74075]:       </nova:owner>
Oct 26 10:17:29 user nova-compute[74075]:       <nova:root type="image" uuid="34f1281b-f0e8-4161-a772-b9c94532af18"/>
Oct 26 10:17:29 user nova-compute[74075]:       <nova:ports>
Oct 26 10:17:29 user nova-compute[74075]:         <nova:port uuid="fb648732-bca7-4343-9b92-558e4d1fc213">
Oct 26 10:17:29 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 10:17:29 user nova-compute[74075]:         </nova:port>
Oct 26 10:17:29 user nova-compute[74075]:       </nova:ports>
Oct 26 10:17:29 user nova-compute[74075]:     </nova:instance>
Oct 26 10:17:29 user nova-compute[74075]:   </metadata>
Oct 26 10:17:29 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:17:29 user nova-compute[74075]:     <system>
Oct 26 10:17:29 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:17:29 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:17:29 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:17:29 user nova-compute[74075]:       <entry name="serial">a6cf9f16-8c14-4275-9baa-51e144c52c28</entry>
Oct 26 10:17:29 user nova-compute[74075]:       <entry name="uuid">a6cf9f16-8c14-4275-9baa-51e144c52c28</entry>
Oct 26 10:17:29 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:17:29 user nova-compute[74075]:     </system>
Oct 26 10:17:29 user nova-compute[74075]:   </sysinfo>
Oct 26 10:17:29 user nova-compute[74075]:   <os>
Oct 26 10:17:29 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:17:29 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:17:29 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:17:29 user nova-compute[74075]:   </os>
Oct 26 10:17:29 user nova-compute[74075]:   <features>
Oct 26 10:17:29 user nova-compute[74075]:     <acpi/>
Oct 26 10:17:29 user nova-compute[74075]:     <apic/>
Oct 26 10:17:29 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:17:29 user nova-compute[74075]:   </features>
Oct 26 10:17:29 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:17:29 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:17:29 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:17:29 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:17:29 user nova-compute[74075]:   </clock>
Oct 26 10:17:29 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:17:29 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:17:29 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:17:29 user nova-compute[74075]:   </cpu>
Oct 26 10:17:29 user nova-compute[74075]:   <devices>
Oct 26 10:17:29 user nova-compute[74075]:     <disk type="file" device="disk">
Oct 26 10:17:29 user nova-compute[74075]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 10:17:29 user nova-compute[74075]:       <source file="/opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk"/>
Oct 26 10:17:29 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:17:29 user nova-compute[74075]:     </disk>
Oct 26 10:17:29 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:17:29 user nova-compute[74075]:       <mac address="fa:16:3e:e0:42:4c"/>
Oct 26 10:17:29 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:17:29 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:17:29 user nova-compute[74075]:       <target dev="tapfb648732-bc"/>
Oct 26 10:17:29 user nova-compute[74075]:     </interface>
Oct 26 10:17:29 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:17:29 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/console.log" append="off"/>
Oct 26 10:17:29 user nova-compute[74075]:     </serial>
Oct 26 10:17:29 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:17:29 user nova-compute[74075]:     <video>
Oct 26 10:17:29 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:17:29 user nova-compute[74075]:     </video>
Oct 26 10:17:29 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:17:29 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:17:29 user nova-compute[74075]:     </rng>
Oct 26 10:17:29 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:17:29 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:17:29 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:17:29 user nova-compute[74075]:     </memballoon>
Oct 26 10:17:29 user nova-compute[74075]:   </devices>
Oct 26 10:17:29 user nova-compute[74075]: </domain>
Oct 26 10:17:29 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-452002464',display_name='tempest-TestMinimumBasicScenario-server-452002464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-452002464',id=46,image_ref='34f1281b-f0e8-4161-a772-b9c94532af18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLHp3LOpPympJXp8ElLdHTxNtg+gcmfoG2hn69PrO+mwppfB/+J8F8fMHMPdO9rn9M2xPazLifK4vtYAT3RsiEal+JZb5nMXe9Byx77HMDkIbfggr5yP+xRU9xPhwaofA==',key_name='tempest-TestMinimumBasicScenario-1896356415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-sb0mud32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34f1281b-f0e8-4161-a772-b9c94532af18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:17:28Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=a6cf9f16-8c14-4275-9baa-51e144c52c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG os_vif [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4000777-1e8c-585c-9291-ee0b6ec8b44c', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb648732-bc, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb648732-bc, col_values=(('qos', UUID('041f68ff-4952-4981-972d-c8de560e7c48')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb648732-bc, col_values=(('external_ids', {'iface-id': 'fb648732-bca7-4343-9b92-558e4d1fc213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:42:4c', 'vm-uuid': 'a6cf9f16-8c14-4275-9baa-51e144c52c28'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:29 user nova-compute[74075]: INFO os_vif [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc')
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:17:29 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No VIF found with MAC fa:16:3e:e0:42:4c, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:17:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated VIF entry in instance network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:17:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:17:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-de79306d-01f4-4677-8b73-b788b6eb3702 req-db071b8a-cd6a-4e7a-952e-6d375192e7f1 service nova] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-7765f123-eab8-46cd-8748-d6df72b83364 req-90ed1140-aa9c-4fe0-9cb4-e16311c309db service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7765f123-eab8-46cd-8748-d6df72b83364 req-90ed1140-aa9c-4fe0-9cb4-e16311c309db service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7765f123-eab8-46cd-8748-d6df72b83364 req-90ed1140-aa9c-4fe0-9cb4-e16311c309db service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-7765f123-eab8-46cd-8748-d6df72b83364 req-90ed1140-aa9c-4fe0-9cb4-e16311c309db service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-7765f123-eab8-46cd-8748-d6df72b83364 req-90ed1140-aa9c-4fe0-9cb4-e16311c309db service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:17:31 user nova-compute[74075]: WARNING nova.compute.manager [req-7765f123-eab8-46cd-8748-d6df72b83364 req-90ed1140-aa9c-4fe0-9cb4-e16311c309db service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state building and task_state spawning.
Oct 26 10:17:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:17:33 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance spawned successfully.
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:17:33 user nova-compute[74075]: INFO nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-daafaac8-5550-47b1-b53a-c5070a00a40c req-550f502c-5cbb-423b-9f4c-16fab17fc014 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-daafaac8-5550-47b1-b53a-c5070a00a40c req-550f502c-5cbb-423b-9f4c-16fab17fc014 service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-daafaac8-5550-47b1-b53a-c5070a00a40c req-550f502c-5cbb-423b-9f4c-16fab17fc014 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-daafaac8-5550-47b1-b53a-c5070a00a40c req-550f502c-5cbb-423b-9f4c-16fab17fc014 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-daafaac8-5550-47b1-b53a-c5070a00a40c req-550f502c-5cbb-423b-9f4c-16fab17fc014 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:17:33 user nova-compute[74075]: WARNING nova.compute.manager [req-daafaac8-5550-47b1-b53a-c5070a00a40c req-550f502c-5cbb-423b-9f4c-16fab17fc014 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state building and task_state spawning.
Oct 26 10:17:33 user nova-compute[74075]: INFO nova.compute.manager [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Took 5.90 seconds to build instance.
Oct 26 10:17:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-19d42552-1adf-494f-87b1-9202c4f0cdd1 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.997s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:17:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:17:36 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:17:36 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.138988494873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a6cf9f16-8c14-4275-9baa-51e144c52c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:17:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:17:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:17:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:17:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:17:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:17:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:17:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:18:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:18:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:18:35 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:18:37 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:18:38 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:18:38 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.110584259033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a6cf9f16-8c14-4275-9baa-51e144c52c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:18:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:18:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:18:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:18:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:18:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:18:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:18:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:18:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:19:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:19:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'flavor' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:24 user nova-compute[74075]: INFO nova.compute.manager [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Attaching volume 6f715afe-a933-49c2-aae7-23b00671e239 to /dev/vdb
Oct 26 10:19:24 user nova-compute[74075]: DEBUG os_brick.utils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dba41c-6312-49bd-91b6-674b2a7ba326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb3f82c-eea1-4102-af8c-848f14fde6d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d8e201-a7d6-4c14-a9bf-1a6637bd1863]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ffbf33-d956-40ea-986f-4992679f2495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:19:24 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:19:24 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0439a55d-feb7-4f6c-9858-1d91af2c34c3]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG os_brick.utils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating existing volume attachment record: aabd4172-c4ed-4b42-bb3c-41f5cc780270 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:19:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:19:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:19:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:38 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:39 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:19:39 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.109798431396484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a6cf9f16-8c14-4275-9baa-51e144c52c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAXghaHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:19:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:19:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:19:41 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feb24bc-91ee-4d5e-971c-68970a81a051]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:19:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5401071-1f41-4d69-ab34-11519fc4833c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239] added
Oct 26 10:19:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6f1cc5-9164-4cc0-b474-cb80e2d0a6d3]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa3380-a866-4b46-aa8f-41efffb6fc7e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAXghaHM {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAXghaHM" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cf8059-d29a-48fa-b64e-55ff4904140d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAXghaHM'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df10546-ba31-44df-8d61-190d2724ba44]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed948a6-695c-45e3-b1fb-74b7393c327c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:19:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:19:41 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:19:41 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:19:41 user nova-compute[74075]: 
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0090ca8-a6d1-42f5-83b1-f12f9da92309]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260]
Oct 26 10:19:41 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260] successful.
Oct 26 10:19:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e27b0b-4299-4b36-a67d-6256ce70a058]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[053b4462-0c31-437a-8143-017a191d7a71]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 (non-flash)
Oct 26 10:19:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 (non-flash)
Oct 26 10:19:41 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[111183a7-fbab-450d-b1e8-05b757d48f45]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:19:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAXghaHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:19:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:19:42 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26633353430336364', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:19:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633353430336364', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:19:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'flavor' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:19:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 10:19:42 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:19:42 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 10:19:42 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 10:19:42 user nova-compute[74075]:   <serial>6f715afe-a933-49c2-aae7-23b00671e239</serial>
Oct 26 10:19:42 user nova-compute[74075]: </disk>
Oct 26 10:19:42 user nova-compute[74075]:  {{(pid=74075) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 10:19:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:19:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:19:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] No VIF found with MAC fa:16:3e:e0:42:4c, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:19:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e52ea11b-1a01-475f-820e-e2c7dff5def0 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.846s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing instance network info cache due to event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:19:45 user nova-compute[74075]: DEBUG nova.network.neutron [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:19:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:19:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated VIF entry in instance network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:19:46 user nova-compute[74075]: DEBUG nova.network.neutron [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:19:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e9dc43c2-91ce-42ac-8b4c-b864405bd4ae req-5072f90f-048a-4777-b232-e1c1fce263f8 service nova] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:19:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:19:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing instance network info cache due to event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:19:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:19:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:19:47 user nova-compute[74075]: DEBUG nova.network.neutron [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG nova.network.neutron [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated VIF entry in instance network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG nova.network.neutron [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2be288c5-b1e4-4d20-8bf7-e224eb516d19 req-f1f8ba52-b481-462f-8a09-bfdb735cffa5 service nova] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:48 user nova-compute[74075]: INFO nova.compute.manager [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Rebooting instance
Oct 26 10:19:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG nova.network.neutron [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG nova.network.neutron [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:19:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:19:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-daddb9e0-0df2-4ba1-a2ac-ae2fae4f55ec req-9edea135-50d9-4b8b-8477-6649b6a90d19 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-unplugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-daddb9e0-0df2-4ba1-a2ac-ae2fae4f55ec req-9edea135-50d9-4b8b-8477-6649b6a90d19 service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-daddb9e0-0df2-4ba1-a2ac-ae2fae4f55ec req-9edea135-50d9-4b8b-8477-6649b6a90d19 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-daddb9e0-0df2-4ba1-a2ac-ae2fae4f55ec req-9edea135-50d9-4b8b-8477-6649b6a90d19 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:51 user nova-compute[74075]: DEBUG nova.compute.manager [req-daddb9e0-0df2-4ba1-a2ac-ae2fae4f55ec req-9edea135-50d9-4b8b-8477-6649b6a90d19 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-unplugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:19:51 user nova-compute[74075]: WARNING nova.compute.manager [req-daddb9e0-0df2-4ba1-a2ac-ae2fae4f55ec req-9edea135-50d9-4b8b-8477-6649b6a90d19 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-unplugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state active and task_state reboot_started.
Oct 26 10:19:51 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance shutdown successfully.
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-2b06cbad-7db2-4d60-a4d1-fef4e1be046a req-58f1cd0d-ba28-43b1-9306-678f69d1fa57 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2b06cbad-7db2-4d60-a4d1-fef4e1be046a req-58f1cd0d-ba28-43b1-9306-678f69d1fa57 service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2b06cbad-7db2-4d60-a4d1-fef4e1be046a req-58f1cd0d-ba28-43b1-9306-678f69d1fa57 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2b06cbad-7db2-4d60-a4d1-fef4e1be046a req-58f1cd0d-ba28-43b1-9306-678f69d1fa57 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG nova.compute.manager [req-2b06cbad-7db2-4d60-a4d1-fef4e1be046a req-58f1cd0d-ba28-43b1-9306-678f69d1fa57 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:19:53 user nova-compute[74075]: WARNING nova.compute.manager [req-2b06cbad-7db2-4d60-a4d1-fef4e1be046a req-58f1cd0d-ba28-43b1-9306-678f69d1fa57 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state active and task_state reboot_started.
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:19:55 user nova-compute[74075]: WARNING nova.compute.manager [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state active and task_state reboot_started.
Oct 26 10:19:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:19:55 user nova-compute[74075]: WARNING nova.compute.manager [req-e48e8faf-8e10-4a59-853b-7b4a6c0ec8f0 req-7d6c2123-9452-45dd-a968-6bf7753ce421 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state active and task_state reboot_started.
Oct 26 10:19:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance running successfully.
Oct 26 10:19:55 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance soft rebooted successfully.
Oct 26 10:19:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:19:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-687f9946-913c-4204-8bd8-d019e7899ea4 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.099s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:19:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:19:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:37 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:20:39 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:20:39 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:20:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=25.10794448852539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:20:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a6cf9f16-8c14-4275-9baa-51e144c52c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:20:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:20:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:20:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:20:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:20:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:20:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:20:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:20:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:21:39 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:21:39 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:21:39 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.107425689697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:21:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a6cf9f16-8c14-4275-9baa-51e144c52c28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing instance network info cache due to event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated VIF entry in instance network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:21:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-22420e46-c807-4667-a95d-4ec4c874e3e9 req-cabb68b6-4c02-485f-8255-26f7e3b79214 service nova] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing instance network info cache due to event network-changed-fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Refreshing network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:21:41 user nova-compute[74075]: INFO nova.compute.manager [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Detaching volume 6f715afe-a933-49c2-aae7-23b00671e239
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated VIF entry in instance network info cache for port fb648732-bca7-4343-9b92-558e4d1fc213. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:21:41 user nova-compute[74075]: INFO nova.virt.block_device [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Attempting to driver detach volume 6f715afe-a933-49c2-aae7-23b00671e239 from mountpoint /dev/vdb
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Attempting to detach device vdb from instance a6cf9f16-8c14-4275-9baa-51e144c52c28 from the persistent domain config. {{(pid=74075) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 10:21:41 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:21:41 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 10:21:41 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 10:21:41 user nova-compute[74075]:   <serial>6f715afe-a933-49c2-aae7-23b00671e239</serial>
Oct 26 10:21:41 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 10:21:41 user nova-compute[74075]: </disk>
Oct 26 10:21:41 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-50254d87-977b-4bbd-927a-fe9a9a5b4724 req-e683ce93-2ab3-4a35-96cd-054e8c6dfd89 service nova] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:21:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully detached device vdb from instance a6cf9f16-8c14-4275-9baa-51e144c52c28 from the persistent domain config.
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6cf9f16-8c14-4275-9baa-51e144c52c28 from the live domain config. {{(pid=74075) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 10:21:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.guest [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 10:21:41 user nova-compute[74075]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:21:41 user nova-compute[74075]:   <source dev="/dev/sdb"/>
Oct 26 10:21:41 user nova-compute[74075]:   <target dev="vdb" bus="virtio"/>
Oct 26 10:21:41 user nova-compute[74075]:   <serial>6f715afe-a933-49c2-aae7-23b00671e239</serial>
Oct 26 10:21:41 user nova-compute[74075]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 10:21:41 user nova-compute[74075]: </disk>
Oct 26 10:21:41 user nova-compute[74075]:  {{(pid=74075) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [{"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:21:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:21:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:21:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:21:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:21:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 10:21:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:21:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:02 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6cf9f16-8c14-4275-9baa-51e144c52c28 is timed out.
Oct 26 10:22:02 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully detached device vdb from instance a6cf9f16-8c14-4275-9baa-51e144c52c28 from the live domain config.
Oct 26 10:22:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAXghaHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:22:02 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2586ba3e-2a2e-4a28-a5dd-48dfd4f6cf99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:22:02 user nova-compute[74075]: No targets found.
Oct 26 10:22:02 user nova-compute[74075]: iSNS:
Oct 26 10:22:02 user nova-compute[74075]: No targets found.
Oct 26 10:22:02 user nova-compute[74075]: STATIC:
Oct 26 10:22:02 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239
Oct 26 10:22:02 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:22:02 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:22:02 user nova-compute[74075]: FIRMWARE:
Oct 26 10:22:02 user nova-compute[74075]: No targets found.
Oct 26 10:22:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:22:02 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:22:02 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[725b0853-9c2c-498a-acf8-91198b3958f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fe2b5-df5d-4962-a723-6e66d1334243]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 (non-flash)
Oct 26 10:22:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 (non-flash)
Oct 26 10:22:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462869d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[58595d3b-9ebe-4383-9fdc-597d2766a13c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daa158d-9202-4b01-804e-264a1d624edf]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f34263a-d305-4a5a-9750-704c59b51f8a]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da2555a-9301-4d3e-b674-8756f2ea312b]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701b1e3-eb53-4532-b6e9-435f07b9eae2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ecca6e-c19c-4f27-a92c-339d665f9e75]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260]
Oct 26 10:22:02 user nova-compute[74075]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239, portal: 172.16.0.220,3260] successful.
Oct 26 10:22:02 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f715afe-a933-49c2-aae7-23b00671e239 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d81e710-827b-4c44-96ae-cbe400870baf]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] <== disconnect_volume: return (273ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:22:02 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:22:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'flavor' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:22:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-e99e413d-da4c-48b6-8b7c-e434f959718e tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.493s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:22:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:22:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:22:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:22:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:22:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:22:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.106552124023438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance a6cf9f16-8c14-4275-9baa-51e144c52c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:41 user nova-compute[74075]: INFO nova.compute.manager [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Terminating instance
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-49900019-f413-4c2d-9733-a64e6d9c076d req-ef61a54b-79c5-4be9-ada4-723e4a069c8f service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-unplugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-49900019-f413-4c2d-9733-a64e6d9c076d req-ef61a54b-79c5-4be9-ada4-723e4a069c8f service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-49900019-f413-4c2d-9733-a64e6d9c076d req-ef61a54b-79c5-4be9-ada4-723e4a069c8f service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-49900019-f413-4c2d-9733-a64e6d9c076d req-ef61a54b-79c5-4be9-ada4-723e4a069c8f service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-49900019-f413-4c2d-9733-a64e6d9c076d req-ef61a54b-79c5-4be9-ada4-723e4a069c8f service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-unplugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:22:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-49900019-f413-4c2d-9733-a64e6d9c076d req-ef61a54b-79c5-4be9-ada4-723e4a069c8f service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-unplugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance destroyed successfully.
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.objects.instance [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lazy-loading 'resources' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-452002464',display_name='tempest-TestMinimumBasicScenario-server-452002464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-452002464',id=46,image_ref='34f1281b-f0e8-4161-a772-b9c94532af18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLHp3LOpPympJXp8ElLdHTxNtg+gcmfoG2hn69PrO+mwppfB/+J8F8fMHMPdO9rn9M2xPazLifK4vtYAT3RsiEal+JZb5nMXe9Byx77HMDkIbfggr5yP+xRU9xPhwaofA==',key_name='tempest-TestMinimumBasicScenario-1896356415',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3dd7f3642ba49d597c0e6dc3ff354e9',ramdisk_id='',reservation_id='r-sb0mud32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34f1281b-f0e8-4161-a772-b9c94532af18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-130688736',owner_user_name='tempest-TestMinimumBasicScenario-130688736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:19:55Z,user_data=None,user_id='169ffc3f50464bbebbf18c5fac1ecf52',uuid=a6cf9f16-8c14-4275-9baa-51e144c52c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converting VIF {"id": "fb648732-bca7-4343-9b92-558e4d1fc213", "address": "fa:16:3e:e0:42:4c", "network": {"id": "95ee53e4-c533-49ce-b223-c0b155939089", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-415086703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3dd7f3642ba49d597c0e6dc3ff354e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb648732-bc", "ovs_interfaceid": "fb648732-bca7-4343-9b92-558e4d1fc213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG os_vif [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb648732-bc, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=041f68ff-4952-4981-972d-c8de560e7c48) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:22:42 user nova-compute[74075]: INFO os_vif [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:42:4c,bridge_name='br-int',has_traffic_filtering=True,id=fb648732-bca7-4343-9b92-558e4d1fc213,network=Network(95ee53e4-c533-49ce-b223-c0b155939089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb648732-bc')
Oct 26 10:22:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Deleting instance files /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28_del
Oct 26 10:22:42 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Deletion of /opt/stack/data/nova/instances/a6cf9f16-8c14-4275-9baa-51e144c52c28_del complete
Oct 26 10:22:42 user nova-compute[74075]: INFO nova.compute.manager [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 10:22:42 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:43 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Took 0.59 seconds to deallocate network for instance.
Oct 26 10:22:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-8e0da419-a753-46ff-82bf-8add8f9c82b2 req-6ec9f6d5-338f-40f1-8b1f-ec1f1898f2ef service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-deleted-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid a6cf9f16-8c14-4275-9baa-51e144c52c28 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:43 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Deleted allocations for instance a6cf9f16-8c14-4275-9baa-51e144c52c28
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-780545ab-18d8-426a-87e9-fa0f568fe132 tempest-TestMinimumBasicScenario-130688736 tempest-TestMinimumBasicScenario-130688736-project-member] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-a6cf9f16-8c14-4275-9baa-51e144c52c28" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:22:43 user nova-compute[74075]: WARNING nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state deleted and task_state None.
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:22:43 user nova-compute[74075]: WARNING nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state deleted and task_state None.
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:22:43 user nova-compute[74075]: WARNING nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state deleted and task_state None.
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Acquiring lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] Lock "a6cf9f16-8c14-4275-9baa-51e144c52c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:22:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] No waiting events found dispatching network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:22:43 user nova-compute[74075]: WARNING nova.compute.manager [req-35b008d6-3e3c-48cb-bb02-c807acf7b2e9 req-7d32f5b1-8ae4-4a2e-acaa-7b63fa78592c service nova] [instance: a6cf9f16-8c14-4275-9baa-51e144c52c28] Received unexpected event network-vif-plugged-fb648732-bca7-4343-9b92-558e4d1fc213 for instance with vm_state deleted and task_state None.
Oct 26 10:22:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:22:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:22:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:23:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:23:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:23:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:23:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:23:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:23:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9076MB free_disk=25.173175811767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:23:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:23:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:23:42 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:23:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:23:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:23:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:23:52 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:57 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:23:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:12 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:24:17 user nova-compute[74075]: INFO nova.compute.claims [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Claim successful on node user
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:24:17 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:24:17 user nova-compute[74075]: DEBUG nova.policy [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f870a45d74547d6ae2ce1395e2d1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd24b2446a4777af68ec4dea66f6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:24:17 user nova-compute[74075]: INFO nova.virt.block_device [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Booting with volume snapshot 57d0163c-a34f-4285-b96b-3f3090c5a0ae at /dev/vda
Oct 26 10:24:18 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Successfully created port: 3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:24:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Successfully updated port: 3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquired lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-changed-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.compute.manager [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Refreshing instance network info cache due to event network-changed-3f2d408f-af26-4f22-af01-a2099eb8bcbd. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] Acquiring lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating instance_info_cache with network_info: [{"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Releasing lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Instance network_info: |[{"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] Acquired lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Refreshing network info cache for port 3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updated VIF entry in instance network info cache for port 3f2d408f-af26-4f22-af01-a2099eb8bcbd. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG nova.network.neutron [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating instance_info_cache with network_info: [{"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:24:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e09a2d7c-b18d-4be9-9226-1ab884af336d req-6120e78b-1890-469a-b7eb-b275cc9cc8be service nova] Releasing lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:24:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG os_brick.utils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781fbf6-7235-4399-b5f4-15a04a92f061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90bd155-6efc-41cc-8f29-b0cd73c84c69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[db800a10-b2ea-4f52-84e4-f065eb97dfc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b49f0-b9c2-4ea7-9ca1-9f17698f9fab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:24:23 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:24:23 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0ad336-39f8-40d1-b373-d3704672b3e8]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG os_brick.utils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:24:23 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating existing volume attachment record: 906c4c09-ed45-4258-ade8-0ee516d34f00 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:24:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:24:40 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Creating image(s)
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Ensure instance console log exists: /opt/stack/data/nova/instances/79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Start _get_guest_xml network_info=[{"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '906c4c09-ed45-4258-ade8-0ee516d34f00', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylSJdmAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'aebd5913-0599-40bc-b4b4-e2b4d47e9070', 'serial': 'aebd5913-0599-40bc-b4b4-e2b4d47e9070'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:24:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:24:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylSJdmAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:24:40 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:24:40 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:24:40 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208fdbd-b219-4b6e-a2bd-3cc60a744dee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:24:40 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcdf80-61a4-4d38-a789-2c247d7ffeb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070] added
Oct 26 10:24:40 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5542b3d-36df-42a2-ba8d-809fe89663e0]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[de673870-20ec-48df-851b-e74748b1ff48]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylSJdmAz {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:24:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9105MB free_disk=25.163204193115234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylSJdmAz" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be1034b-85d0-4be7-bfc3-89af7a310155]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylSJdmAz'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62e8d1-2624-41f6-ae1c-bfef25e45c33]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e0aed1-9317-4cef-8061-6defbe4e69bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:24:40 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:24:40 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:24:40 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:24:40 user nova-compute[74075]: 
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5881e8-57fa-495e-9119-56f9cd9ee0a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260]
Oct 26 10:24:40 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260] successful.
Oct 26 10:24:40 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b3fb4-c609-4e3e-8ef1-9ae2923d7fc8]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c2fda3-beb8-4dab-b035-a0a27191c567]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 (non-flash)
Oct 26 10:24:40 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 (non-flash)
Oct 26 10:24:40 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.628s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f0254-c462-43a2-ad99-cdb08eaa7f14]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:24:40 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylSJdmAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.658s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== connect_volume: return (1660ms) {'type': 'block', 'scsi_wwn': '23833633231656536', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833633231656536', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1641187596',display_name='tempest-TestVolumeBootPattern-server-1641187596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1641187596',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-og7u3kk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:24:18Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.objects.instance [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'pci_devices' on Instance uuid 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:24:41 user nova-compute[74075]:   <uuid>79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4</uuid>
Oct 26 10:24:41 user nova-compute[74075]:   <name>instance-0000002f</name>
Oct 26 10:24:41 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:24:41 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:24:41 user nova-compute[74075]:   <metadata>
Oct 26 10:24:41 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:24:41 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:24:41 user nova-compute[74075]:       <nova:name>tempest-TestVolumeBootPattern-server-1641187596</nova:name>
Oct 26 10:24:41 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:24:40</nova:creationTime>
Oct 26 10:24:41 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:24:41 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:24:41 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:24:41 user nova-compute[74075]:       <nova:owner>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:user uuid="2f870a45d74547d6ae2ce1395e2d1588">tempest-TestVolumeBootPattern-1296213444-project-member</nova:user>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:project uuid="f8dd24b2446a4777af68ec4dea66f6c7">tempest-TestVolumeBootPattern-1296213444</nova:project>
Oct 26 10:24:41 user nova-compute[74075]:       </nova:owner>
Oct 26 10:24:41 user nova-compute[74075]:       <nova:ports>
Oct 26 10:24:41 user nova-compute[74075]:         <nova:port uuid="3f2d408f-af26-4f22-af01-a2099eb8bcbd">
Oct 26 10:24:41 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 10:24:41 user nova-compute[74075]:         </nova:port>
Oct 26 10:24:41 user nova-compute[74075]:       </nova:ports>
Oct 26 10:24:41 user nova-compute[74075]:     </nova:instance>
Oct 26 10:24:41 user nova-compute[74075]:   </metadata>
Oct 26 10:24:41 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:24:41 user nova-compute[74075]:     <system>
Oct 26 10:24:41 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:24:41 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:24:41 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:24:41 user nova-compute[74075]:       <entry name="serial">79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4</entry>
Oct 26 10:24:41 user nova-compute[74075]:       <entry name="uuid">79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4</entry>
Oct 26 10:24:41 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:24:41 user nova-compute[74075]:     </system>
Oct 26 10:24:41 user nova-compute[74075]:   </sysinfo>
Oct 26 10:24:41 user nova-compute[74075]:   <os>
Oct 26 10:24:41 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:24:41 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:24:41 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:24:41 user nova-compute[74075]:   </os>
Oct 26 10:24:41 user nova-compute[74075]:   <features>
Oct 26 10:24:41 user nova-compute[74075]:     <acpi/>
Oct 26 10:24:41 user nova-compute[74075]:     <apic/>
Oct 26 10:24:41 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:24:41 user nova-compute[74075]:   </features>
Oct 26 10:24:41 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:24:41 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:24:41 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:24:41 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:24:41 user nova-compute[74075]:   </clock>
Oct 26 10:24:41 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:24:41 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:24:41 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:24:41 user nova-compute[74075]:   </cpu>
Oct 26 10:24:41 user nova-compute[74075]:   <devices>
Oct 26 10:24:41 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:24:41 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:24:41 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 10:24:41 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:24:41 user nova-compute[74075]:       <serial>aebd5913-0599-40bc-b4b4-e2b4d47e9070</serial>
Oct 26 10:24:41 user nova-compute[74075]:     </disk>
Oct 26 10:24:41 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:24:41 user nova-compute[74075]:       <mac address="fa:16:3e:c1:27:d5"/>
Oct 26 10:24:41 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:24:41 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:24:41 user nova-compute[74075]:       <target dev="tap3f2d408f-af"/>
Oct 26 10:24:41 user nova-compute[74075]:     </interface>
Oct 26 10:24:41 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:24:41 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4/console.log" append="off"/>
Oct 26 10:24:41 user nova-compute[74075]:     </serial>
Oct 26 10:24:41 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:24:41 user nova-compute[74075]:     <video>
Oct 26 10:24:41 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:24:41 user nova-compute[74075]:     </video>
Oct 26 10:24:41 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:24:41 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:24:41 user nova-compute[74075]:     </rng>
Oct 26 10:24:41 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:24:41 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:24:41 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:24:41 user nova-compute[74075]:     </memballoon>
Oct 26 10:24:41 user nova-compute[74075]:   </devices>
Oct 26 10:24:41 user nova-compute[74075]: </domain>
Oct 26 10:24:41 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1641187596',display_name='tempest-TestVolumeBootPattern-server-1641187596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1641187596',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-og7u3kk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:24:18Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG os_vif [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f49074f9-db1a-523d-99cb-8f3bb23b105f', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f2d408f-af, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f2d408f-af, col_values=(('qos', UUID('7f6bca6f-ca4c-488a-acff-7dfb09e04afe')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f2d408f-af, col_values=(('external_ids', {'iface-id': '3f2d408f-af26-4f22-af01-a2099eb8bcbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:27:d5', 'vm-uuid': '79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:41 user nova-compute[74075]: INFO os_vif [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af')
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:24:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No VIF found with MAC fa:16:3e:c1:27:d5, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-4dbee987-63e8-4cd1-830e-f8eae2dc08fc req-63d44276-295a-45ed-92f4-ce594c4cf3f3 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4dbee987-63e8-4cd1-830e-f8eae2dc08fc req-63d44276-295a-45ed-92f4-ce594c4cf3f3 service nova] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4dbee987-63e8-4cd1-830e-f8eae2dc08fc req-63d44276-295a-45ed-92f4-ce594c4cf3f3 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4dbee987-63e8-4cd1-830e-f8eae2dc08fc req-63d44276-295a-45ed-92f4-ce594c4cf3f3 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG nova.compute.manager [req-4dbee987-63e8-4cd1-830e-f8eae2dc08fc req-63d44276-295a-45ed-92f4-ce594c4cf3f3 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] No waiting events found dispatching network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:24:43 user nova-compute[74075]: WARNING nova.compute.manager [req-4dbee987-63e8-4cd1-830e-f8eae2dc08fc req-63d44276-295a-45ed-92f4-ce594c4cf3f3 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received unexpected event network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd for instance with vm_state building and task_state spawning.
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:24:45 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Instance spawned successfully.
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:24:45 user nova-compute[74075]: INFO nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-90cc986e-b511-4211-aa55-0a6d0a3f7113 req-7cc045f9-e7b5-45d9-9ca0-60d7d35d9be9 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-90cc986e-b511-4211-aa55-0a6d0a3f7113 req-7cc045f9-e7b5-45d9-9ca0-60d7d35d9be9 service nova] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-90cc986e-b511-4211-aa55-0a6d0a3f7113 req-7cc045f9-e7b5-45d9-9ca0-60d7d35d9be9 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-90cc986e-b511-4211-aa55-0a6d0a3f7113 req-7cc045f9-e7b5-45d9-9ca0-60d7d35d9be9 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:45 user nova-compute[74075]: DEBUG nova.compute.manager [req-90cc986e-b511-4211-aa55-0a6d0a3f7113 req-7cc045f9-e7b5-45d9-9ca0-60d7d35d9be9 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] No waiting events found dispatching network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:24:45 user nova-compute[74075]: WARNING nova.compute.manager [req-90cc986e-b511-4211-aa55-0a6d0a3f7113 req-7cc045f9-e7b5-45d9-9ca0-60d7d35d9be9 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received unexpected event network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd for instance with vm_state building and task_state spawning.
Oct 26 10:24:45 user nova-compute[74075]: INFO nova.compute.manager [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Took 28.26 seconds to build instance.
Oct 26 10:24:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-5e71416b-444d-4ca3-a93a-88044f7d5913 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.354s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating instance_info_cache with network_info: [{"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:24:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:24:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:24:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:25:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:25:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.161907196044922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:25:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:25:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating instance_info_cache with network_info: [{"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:25:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:25:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:25:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:25:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:25:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:26:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:07 user nova-compute[74075]: INFO nova.compute.manager [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Terminating instance
Oct 26 10:26:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-a40144b5-d83e-4ced-845f-1587b1020beb req-1f68471c-0671-49dd-baff-0944d8067920 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-vif-unplugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a40144b5-d83e-4ced-845f-1587b1020beb req-1f68471c-0671-49dd-baff-0944d8067920 service nova] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a40144b5-d83e-4ced-845f-1587b1020beb req-1f68471c-0671-49dd-baff-0944d8067920 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a40144b5-d83e-4ced-845f-1587b1020beb req-1f68471c-0671-49dd-baff-0944d8067920 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-a40144b5-d83e-4ced-845f-1587b1020beb req-1f68471c-0671-49dd-baff-0944d8067920 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] No waiting events found dispatching network-vif-unplugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:26:07 user nova-compute[74075]: DEBUG nova.compute.manager [req-a40144b5-d83e-4ced-845f-1587b1020beb req-1f68471c-0671-49dd-baff-0944d8067920 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-vif-unplugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Instance destroyed successfully.
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.objects.instance [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'resources' on Instance uuid 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1641187596',display_name='tempest-TestVolumeBootPattern-server-1641187596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1641187596',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-og7u3kk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:24:45Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "address": "fa:16:3e:c1:27:d5", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2d408f-af", "ovs_interfaceid": "3f2d408f-af26-4f22-af01-a2099eb8bcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_vif [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f2d408f-af, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f6bca6f-ca4c-488a-acff-7dfb09e04afe) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:08 user nova-compute[74075]: INFO os_vif [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:27:d5,bridge_name='br-int',has_traffic_filtering=True,id=3f2d408f-af26-4f22-af01-a2099eb8bcbd,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2d408f-af')
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylSJdmAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:26:08 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5157b6ec-33f4-4dd9-a660-300a7a3d3a6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:26:08 user nova-compute[74075]: No targets found.
Oct 26 10:26:08 user nova-compute[74075]: iSNS:
Oct 26 10:26:08 user nova-compute[74075]: No targets found.
Oct 26 10:26:08 user nova-compute[74075]: STATIC:
Oct 26 10:26:08 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070
Oct 26 10:26:08 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:26:08 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:26:08 user nova-compute[74075]: FIRMWARE:
Oct 26 10:26:08 user nova-compute[74075]: No targets found.
Oct 26 10:26:08 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:26:08 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:26:08 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[046b78e9-faa7-4bed-b261-b71dd2fb7fee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[337aa0aa-14b1-471f-9bbb-c471e355cc78]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 (non-flash)
Oct 26 10:26:08 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 (non-flash)
Oct 26 10:26:08 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46641fd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f1901-d32c-4033-a878-9d7300d7668c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f68e26-e729-4298-8b4f-415a674f33aa]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b590d6f0-24d3-429b-80e0-dfb017356e4f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e68d22-dae1-4e7f-8a61-95ea41b54be2]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7db71c80', '/dev/disk/by-id/scsi-1SCST_BIO7db71c80-83c21ee6f33f1d6d', '/dev/disk/by-id/scsi-23833633231656536') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ce4c0-7240-4256-b323-d22c05238b0e]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e0924c-0b6f-4eb2-8e00-b52d4a13fbbb]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c52aa8-0fcd-4980-9891-d2af0e58f2b2]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260]
Oct 26 10:26:08 user nova-compute[74075]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070, portal: 172.16.0.220,3260] successful.
Oct 26 10:26:08 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebd5913-0599-40bc-b4b4-e2b4d47e9070 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81a7493-e402-4361-bc1c-857b5463f473]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== disconnect_volume: return (286ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:26:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Deleting instance files /opt/stack/data/nova/instances/79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4_del
Oct 26 10:26:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Deletion of /opt/stack/data/nova/instances/79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4_del complete
Oct 26 10:26:08 user nova-compute[74075]: INFO nova.compute.manager [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 26 10:26:08 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:26:08 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:26:09 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:26:09 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Took 0.42 seconds to deallocate network for instance.
Oct 26 10:26:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-94a59581-5abf-4fef-935d-2b9331e627df req-46c25492-5a24-470c-a889-69f1afd8deae service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-vif-deleted-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:26:09 user nova-compute[74075]: INFO nova.compute.manager [req-94a59581-5abf-4fef-935d-2b9331e627df req-46c25492-5a24-470c-a889-69f1afd8deae service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Neutron deleted interface 3f2d408f-af26-4f22-af01-a2099eb8bcbd; detaching it from the instance and deleting it from the info cache
Oct 26 10:26:09 user nova-compute[74075]: DEBUG nova.network.neutron [req-94a59581-5abf-4fef-935d-2b9331e627df req-46c25492-5a24-470c-a889-69f1afd8deae service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:26:09 user nova-compute[74075]: DEBUG nova.compute.manager [req-94a59581-5abf-4fef-935d-2b9331e627df req-46c25492-5a24-470c-a889-69f1afd8deae service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Detach interface failed, port_id=3f2d408f-af26-4f22-af01-a2099eb8bcbd, reason: Instance 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-4d915dbf-86b4-4dea-ad92-df0b25872e1b req-004e6f33-b57f-4ed5-949a-60cab86e9951 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received event network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4d915dbf-86b4-4dea-ad92-df0b25872e1b req-004e6f33-b57f-4ed5-949a-60cab86e9951 service nova] Acquiring lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4d915dbf-86b4-4dea-ad92-df0b25872e1b req-004e6f33-b57f-4ed5-949a-60cab86e9951 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-4d915dbf-86b4-4dea-ad92-df0b25872e1b req-004e6f33-b57f-4ed5-949a-60cab86e9951 service nova] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG nova.compute.manager [req-4d915dbf-86b4-4dea-ad92-df0b25872e1b req-004e6f33-b57f-4ed5-949a-60cab86e9951 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] No waiting events found dispatching network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:26:10 user nova-compute[74075]: WARNING nova.compute.manager [req-4d915dbf-86b4-4dea-ad92-df0b25872e1b req-004e6f33-b57f-4ed5-949a-60cab86e9951 service nova] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Received unexpected event network-vif-plugged-3f2d408f-af26-4f22-af01-a2099eb8bcbd for instance with vm_state active and task_state deleting.
Oct 26 10:26:10 user nova-compute[74075]: INFO nova.compute.manager [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Took 0.84 seconds to detach 1 volumes for instance.
Oct 26 10:26:10 user nova-compute[74075]: DEBUG nova.compute.manager [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4] Deleting volume: aebd5913-0599-40bc-b4b4-e2b4d47e9070 {{(pid=74075) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:10 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Deleted allocations for instance 79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4
Oct 26 10:26:10 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-3d520707-796f-47e5-be39-10c71cbb5c5d tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "79c4ae64-0ab4-4cd8-b550-c651c3f3f7b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.828s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:26:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:26:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:26:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:26:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=25.161083221435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:26:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:26:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:26:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:26:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:26:44 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:26:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:26:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:26:48 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:26:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:26:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:26:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:27:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:27:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:27:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "0d839e24-a856-485e-8001-6fd13684dbd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:27:34 user nova-compute[74075]: INFO nova.compute.claims [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Claim successful on node user
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:27:34 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:27:34 user nova-compute[74075]: INFO nova.virt.block_device [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Booting with volume 4becb9f8-2252-4707-9a9b-c20e990d0fd3 at /dev/vda
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.policy [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f870a45d74547d6ae2ce1395e2d1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd24b2446a4777af68ec4dea66f6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG os_brick.utils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed82a11-f8a2-49fc-b51d-0ff2e2f5497c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b2c20f-8621-4092-8a23-2d55aa2f638a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c205c8b-d84d-420b-bee4-ba7cfce5f817]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[240cf0d8-1348-4b13-8d96-23fd7c8dcfc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:27:34 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:27:34 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9411aa-f1c1-4d3d-9c7d-43a30e793088]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG os_brick.utils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:27:34 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating existing volume attachment record: b07c1858-c113-408d-838e-5181b22919b4 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Successfully created port: df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Successfully updated port: df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquired lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-changed-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Refreshing instance network info cache due to event network-changed-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] Acquiring lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:27:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Releasing lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Instance network_info: |[{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] Acquired lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Refreshing network info cache for port df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updated VIF entry in instance network info cache for port df1d4ff9-4774-47e7-b6ba-0fc6e323ae13. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:27:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-543433cc-faa6-4953-ba0c-4bf3a5af1088 req-b63fca7c-f892-45ba-a3d2-3f7c68bc7dc3 service nova] Releasing lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:27:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:27:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:27:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=25.159687042236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0d839e24-a856-485e-8001-6fd13684dbd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:27:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:27:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:27:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:27:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:46 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:46 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:27:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:27:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:27:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Skipping network cache update for instance because it is Building. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 10:27:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:27:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:27:52 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Creating image(s)
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Ensure instance console log exists: /opt/stack/data/nova/instances/0d839e24-a856-485e-8001-6fd13684dbd8/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Start _get_guest_xml network_info=[{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'b07c1858-c113-408d-838e-5181b22919b4', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muXvdhSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d839e24-a856-485e-8001-6fd13684dbd8', 'attached_at': '', 'detached_at': '', 'volume_id': '4becb9f8-2252-4707-9a9b-c20e990d0fd3', 'serial': '4becb9f8-2252-4707-9a9b-c20e990d0fd3'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:27:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:27:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muXvdhSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:27:52 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:27:52 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:27:52 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad4449f-c1fe-4075-9a29-31da5388095a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:27:52 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[30364c50-1d9d-4fcd-b5a6-f2f9826f47f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3] added
Oct 26 10:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a62d0a-e572-43ba-b974-f4f329b6fda2]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d51f7-601e-474d-bad8-becb713ecb2d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muXvdhSz {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muXvdhSz" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeddc6e-983b-46fb-bfff-6aa3d80dc160]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muXvdhSz'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4468ba30-3b90-43ab-b511-34f82ff01c4d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccf418e-494c-44f4-8126-fee5c711decf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:27:52 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:27:52 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:27:52 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:27:52 user nova-compute[74075]: 
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1589af-c244-49ec-8a7e-2af5768e95ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260]
Oct 26 10:27:52 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260] successful.
Oct 26 10:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c949b171-dc0e-406b-bd07-be39b53489be]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[becafb85-f84b-41a1-b88a-2430e0525725]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:27:52 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf8ae1-b146-45b1-8273-75700aa44f2e]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:27:52 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muXvdhSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23836646435366431', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836646435366431', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:27:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1998461543',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1998461543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1998461543',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyIe70tNAYRHijeGb9sNrWdQgZP5qC5PvsUjGZUC7Q/+xm3kE5TnhMfvxABwcaPZQOo9tWXWVRWp2NIAiSWKq2oCGEa9XOMlY03+rGSATTL8K3Q1oM2bWLQ4E70L29ClQ==',key_name='tempest-keypair-2129321058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-wf3er7c7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=0d839e24-a856-485e-8001-6fd13684dbd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.objects.instance [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d839e24-a856-485e-8001-6fd13684dbd8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:27:53 user nova-compute[74075]:   <uuid>0d839e24-a856-485e-8001-6fd13684dbd8</uuid>
Oct 26 10:27:53 user nova-compute[74075]:   <name>instance-00000030</name>
Oct 26 10:27:53 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:27:53 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:27:53 user nova-compute[74075]:   <metadata>
Oct 26 10:27:53 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:27:53 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:27:53 user nova-compute[74075]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1998461543</nova:name>
Oct 26 10:27:53 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:27:52</nova:creationTime>
Oct 26 10:27:53 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:27:53 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:27:53 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:27:53 user nova-compute[74075]:       <nova:owner>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:user uuid="2f870a45d74547d6ae2ce1395e2d1588">tempest-TestVolumeBootPattern-1296213444-project-member</nova:user>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:project uuid="f8dd24b2446a4777af68ec4dea66f6c7">tempest-TestVolumeBootPattern-1296213444</nova:project>
Oct 26 10:27:53 user nova-compute[74075]:       </nova:owner>
Oct 26 10:27:53 user nova-compute[74075]:       <nova:ports>
Oct 26 10:27:53 user nova-compute[74075]:         <nova:port uuid="df1d4ff9-4774-47e7-b6ba-0fc6e323ae13">
Oct 26 10:27:53 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 10:27:53 user nova-compute[74075]:         </nova:port>
Oct 26 10:27:53 user nova-compute[74075]:       </nova:ports>
Oct 26 10:27:53 user nova-compute[74075]:     </nova:instance>
Oct 26 10:27:53 user nova-compute[74075]:   </metadata>
Oct 26 10:27:53 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:27:53 user nova-compute[74075]:     <system>
Oct 26 10:27:53 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:27:53 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:27:53 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:27:53 user nova-compute[74075]:       <entry name="serial">0d839e24-a856-485e-8001-6fd13684dbd8</entry>
Oct 26 10:27:53 user nova-compute[74075]:       <entry name="uuid">0d839e24-a856-485e-8001-6fd13684dbd8</entry>
Oct 26 10:27:53 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:27:53 user nova-compute[74075]:     </system>
Oct 26 10:27:53 user nova-compute[74075]:   </sysinfo>
Oct 26 10:27:53 user nova-compute[74075]:   <os>
Oct 26 10:27:53 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:27:53 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:27:53 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:27:53 user nova-compute[74075]:   </os>
Oct 26 10:27:53 user nova-compute[74075]:   <features>
Oct 26 10:27:53 user nova-compute[74075]:     <acpi/>
Oct 26 10:27:53 user nova-compute[74075]:     <apic/>
Oct 26 10:27:53 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:27:53 user nova-compute[74075]:   </features>
Oct 26 10:27:53 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:27:53 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:27:53 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:27:53 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:27:53 user nova-compute[74075]:   </clock>
Oct 26 10:27:53 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:27:53 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:27:53 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:27:53 user nova-compute[74075]:   </cpu>
Oct 26 10:27:53 user nova-compute[74075]:   <devices>
Oct 26 10:27:53 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:27:53 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:27:53 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 10:27:53 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:27:53 user nova-compute[74075]:       <serial>4becb9f8-2252-4707-9a9b-c20e990d0fd3</serial>
Oct 26 10:27:53 user nova-compute[74075]:     </disk>
Oct 26 10:27:53 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:27:53 user nova-compute[74075]:       <mac address="fa:16:3e:97:57:5a"/>
Oct 26 10:27:53 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:27:53 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:27:53 user nova-compute[74075]:       <target dev="tapdf1d4ff9-47"/>
Oct 26 10:27:53 user nova-compute[74075]:     </interface>
Oct 26 10:27:53 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:27:53 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/0d839e24-a856-485e-8001-6fd13684dbd8/console.log" append="off"/>
Oct 26 10:27:53 user nova-compute[74075]:     </serial>
Oct 26 10:27:53 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:27:53 user nova-compute[74075]:     <video>
Oct 26 10:27:53 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:27:53 user nova-compute[74075]:     </video>
Oct 26 10:27:53 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:27:53 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:27:53 user nova-compute[74075]:     </rng>
Oct 26 10:27:53 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:27:53 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:27:53 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:27:53 user nova-compute[74075]:     </memballoon>
Oct 26 10:27:53 user nova-compute[74075]:   </devices>
Oct 26 10:27:53 user nova-compute[74075]: </domain>
Oct 26 10:27:53 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:27:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1998461543',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1998461543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1998461543',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyIe70tNAYRHijeGb9sNrWdQgZP5qC5PvsUjGZUC7Q/+xm3kE5TnhMfvxABwcaPZQOo9tWXWVRWp2NIAiSWKq2oCGEa9XOMlY03+rGSATTL8K3Q1oM2bWLQ4E70L29ClQ==',key_name='tempest-keypair-2129321058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-wf3er7c7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=0d839e24-a856-485e-8001-6fd13684dbd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG os_vif [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3af9849-a8a7-5302-885c-d968d9d5f605', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf1d4ff9-47, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf1d4ff9-47, col_values=(('qos', UUID('9e7f958e-2db5-4947-880a-a74dc7486af2')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf1d4ff9-47, col_values=(('external_ids', {'iface-id': 'df1d4ff9-4774-47e7-b6ba-0fc6e323ae13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:57:5a', 'vm-uuid': '0d839e24-a856-485e-8001-6fd13684dbd8'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:53 user nova-compute[74075]: INFO os_vif [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47')
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:27:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No VIF found with MAC fa:16:3e:97:57:5a, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:27:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:54 user nova-compute[74075]: DEBUG nova.compute.manager [req-a87efdae-159d-436f-b29e-b48d29c580b2 req-372430b5-86a2-48d4-8141-6e486e77270a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:27:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a87efdae-159d-436f-b29e-b48d29c580b2 req-372430b5-86a2-48d4-8141-6e486e77270a service nova] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a87efdae-159d-436f-b29e-b48d29c580b2 req-372430b5-86a2-48d4-8141-6e486e77270a service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:55 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a87efdae-159d-436f-b29e-b48d29c580b2 req-372430b5-86a2-48d4-8141-6e486e77270a service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:55 user nova-compute[74075]: DEBUG nova.compute.manager [req-a87efdae-159d-436f-b29e-b48d29c580b2 req-372430b5-86a2-48d4-8141-6e486e77270a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] No waiting events found dispatching network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:27:55 user nova-compute[74075]: WARNING nova.compute.manager [req-a87efdae-159d-436f-b29e-b48d29c580b2 req-372430b5-86a2-48d4-8141-6e486e77270a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received unexpected event network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 for instance with vm_state building and task_state spawning.
Oct 26 10:27:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:27:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:27:56 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Instance spawned successfully.
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:27:56 user nova-compute[74075]: INFO nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Took 4.85 seconds to spawn the instance on the hypervisor.
Oct 26 10:27:56 user nova-compute[74075]: DEBUG nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:27:56 user nova-compute[74075]: INFO nova.compute.manager [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Took 22.64 seconds to build instance.
Oct 26 10:27:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-0ec8fba7-813d-45ce-9b0c-ba72aa27b110 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "0d839e24-a856-485e-8001-6fd13684dbd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.743s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-47591f04-03b7-4445-856a-3e0a5f99df41 req-7c3eed18-4f39-4983-8ead-21541ad07062 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-47591f04-03b7-4445-856a-3e0a5f99df41 req-7c3eed18-4f39-4983-8ead-21541ad07062 service nova] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-47591f04-03b7-4445-856a-3e0a5f99df41 req-7c3eed18-4f39-4983-8ead-21541ad07062 service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:27:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-47591f04-03b7-4445-856a-3e0a5f99df41 req-7c3eed18-4f39-4983-8ead-21541ad07062 service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:27:57 user nova-compute[74075]: DEBUG nova.compute.manager [req-47591f04-03b7-4445-856a-3e0a5f99df41 req-7c3eed18-4f39-4983-8ead-21541ad07062 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] No waiting events found dispatching network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:27:57 user nova-compute[74075]: WARNING nova.compute.manager [req-47591f04-03b7-4445-856a-3e0a5f99df41 req-7c3eed18-4f39-4983-8ead-21541ad07062 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received unexpected event network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 for instance with vm_state active and task_state None.
Oct 26 10:27:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:27:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:28:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:28:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:28:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:28:40 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.15827178955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0d839e24-a856-485e-8001-6fd13684dbd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:28:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:28:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:28:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:48 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 0d839e24-a856-485e-8001-6fd13684dbd8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:28:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:28:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:28:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:28:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:28:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:28:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:29:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-changed-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG nova.compute.manager [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Refreshing instance network info cache due to event network-changed-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] Acquiring lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] Acquired lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Refreshing network info cache for port df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updated VIF entry in instance network info cache for port df1d4ff9-4774-47e7-b6ba-0fc6e323ae13. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG nova.network.neutron [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:29:25 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-621538de-25b7-4b34-bef6-c01b0ab635d7 req-6673950b-3126-41bc-8183-5de96ea39b7a service nova] Releasing lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:29:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:37 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:29:39 user nova-compute[74075]: INFO nova.compute.claims [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Claim successful on node user
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:29:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.network.neutron [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:29:39 user nova-compute[74075]: DEBUG nova.policy [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f870a45d74547d6ae2ce1395e2d1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd24b2446a4777af68ec4dea66f6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:29:39 user nova-compute[74075]: INFO nova.virt.block_device [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Booting with volume snapshot 038e29c8-cb03-4400-810d-105193d13264 at /dev/vda
Oct 26 10:29:40 user nova-compute[74075]: DEBUG nova.network.neutron [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Successfully created port: 2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Successfully updated port: 2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquired lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-changed-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.manager [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Refreshing instance network info cache due to event network-changed-2dd25632-78f8-470b-850d-65dfdd40064b. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] Acquiring lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:29:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:29:41 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.15703582763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0d839e24-a856-485e-8001-6fd13684dbd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance baf14dc1-2ca0-4919-a949-3f68208dcfa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updating instance_info_cache with network_info: [{"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Releasing lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Instance network_info: |[{"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] Acquired lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:29:41 user nova-compute[74075]: DEBUG nova.network.neutron [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Refreshing network info cache for port 2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:29:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updated VIF entry in instance network info cache for port 2dd25632-78f8-470b-850d-65dfdd40064b. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:29:42 user nova-compute[74075]: DEBUG nova.network.neutron [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updating instance_info_cache with network_info: [{"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:29:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-9f2585a1-9051-415c-b449-856e5e2de583 req-365db462-7334-4e53-b22c-32e25b2197ef service nova] Releasing lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:29:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG os_brick.utils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6695febb-fa3a-4ce0-be44-8197961dc215]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9546d4b3-08c3-4d2e-a4fb-c66591f5f0ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5901ee8d-8d3c-4ee2-8e2e-ea1cfdf1ab31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4390c5d-a4aa-4e1c-83f3-6b88da015123]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:29:45 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:29:45 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc418334-35c9-4e75-bacd-f0ba68e996f7]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG os_brick.utils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:29:45 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updating existing volume attachment record: 45e75e72-87f4-4e5e-af63-182fbfcc89e4 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:29:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:29:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Skipping network cache update for instance because it is Building. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:29:50 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 0d839e24-a856-485e-8001-6fd13684dbd8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:29:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:29:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:29:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:29:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:29:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:29:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:29:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:29:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:29:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:29:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:30:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Creating image(s)
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Ensure instance console log exists: /opt/stack/data/nova/instances/baf14dc1-2ca0-4919-a949-3f68208dcfa6/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Start _get_guest_xml network_info=[{"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T10:29:28Z,direct_url=<?>,disk_format='qcow2',id=5a2984dd-215d-459b-a558-bdec9ff1eb0a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1228191333',owner='f8dd24b2446a4777af68ec4dea66f6c7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T10:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '45e75e72-87f4-4e5e-af63-182fbfcc89e4', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFBtPgTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'baf14dc1-2ca0-4919-a949-3f68208dcfa6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f760d4ad-57a1-4b1d-825d-9d5a8465158e', 'serial': 'f760d4ad-57a1-4b1d-825d-9d5a8465158e'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:30:03 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T10:29:28Z,direct_url=<?>,disk_format='qcow2',id=5a2984dd-215d-459b-a558-bdec9ff1eb0a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1228191333',owner='f8dd24b2446a4777af68ec4dea66f6c7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T10:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFBtPgTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:30:03 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:30:03 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:30:03 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ae935-2c8f-440d-be94-a930a428da62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:30:03 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0422a967-406b-4975-8263-6fd3c30793ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e] added
Oct 26 10:30:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6437c2c0-2681-42c2-ac0f-27fbaabccb20]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1944a2-9e01-4907-a28c-c33cb55b399f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFBtPgTJ {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFBtPgTJ" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c917d1d4-ed9f-47ad-b4ed-26c0f999b00f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFBtPgTJ'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[925eff86-b8b1-4ecb-b368-4161fd6f5777]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4257fe03-3463-43e0-8850-10693e3f0f0b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:30:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:30:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[981a058c-fe07-4949-9f47-dee3bb880c7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260]
Oct 26 10:30:03 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260] successful.
Oct 26 10:30:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15a8c85-9519-45b5-8f26-762973b6b124]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[564116ee-fc6b-4299-93b4-605049449a73]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:30:03 user nova-compute[74075]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e (non-flash)
Oct 26 10:30:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:30:03 user nova-compute[74075]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e (non-flash)
Oct 26 10:30:03 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[326a6e8e-2d8b-4482-b526-959b010a595b]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:30:03 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFBtPgTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23033353832316234', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033353832316234', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1430978455',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1430978455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1430978455',id=49,image_ref='5a2984dd-215d-459b-a558-bdec9ff1eb0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz503OSmulJBkftXm79e7EjIYb8k4EB3SgefJ3d1jM5Jiqomtjz1SX50cSPSCxZA3t7dEU3IXzdPk3o+tHFjV07rvQ8/cwxkroKMNxNYCmJx7DsWMQOCq49rZ2vsWIfjg==',key_name='tempest-keypair-318161322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-8hw746ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1296213444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=baf14dc1-2ca0-4919-a949-3f68208dcfa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.objects.instance [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'pci_devices' on Instance uuid baf14dc1-2ca0-4919-a949-3f68208dcfa6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:30:04 user nova-compute[74075]:   <uuid>baf14dc1-2ca0-4919-a949-3f68208dcfa6</uuid>
Oct 26 10:30:04 user nova-compute[74075]:   <name>instance-00000031</name>
Oct 26 10:30:04 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:30:04 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:30:04 user nova-compute[74075]:   <metadata>
Oct 26 10:30:04 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:30:04 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:30:04 user nova-compute[74075]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1430978455</nova:name>
Oct 26 10:30:04 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:30:03</nova:creationTime>
Oct 26 10:30:04 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:30:04 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:30:04 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:30:04 user nova-compute[74075]:       <nova:owner>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:user uuid="2f870a45d74547d6ae2ce1395e2d1588">tempest-TestVolumeBootPattern-1296213444-project-member</nova:user>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:project uuid="f8dd24b2446a4777af68ec4dea66f6c7">tempest-TestVolumeBootPattern-1296213444</nova:project>
Oct 26 10:30:04 user nova-compute[74075]:       </nova:owner>
Oct 26 10:30:04 user nova-compute[74075]:       <nova:root type="image" uuid="5a2984dd-215d-459b-a558-bdec9ff1eb0a"/>
Oct 26 10:30:04 user nova-compute[74075]:       <nova:ports>
Oct 26 10:30:04 user nova-compute[74075]:         <nova:port uuid="2dd25632-78f8-470b-850d-65dfdd40064b">
Oct 26 10:30:04 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 10:30:04 user nova-compute[74075]:         </nova:port>
Oct 26 10:30:04 user nova-compute[74075]:       </nova:ports>
Oct 26 10:30:04 user nova-compute[74075]:     </nova:instance>
Oct 26 10:30:04 user nova-compute[74075]:   </metadata>
Oct 26 10:30:04 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:30:04 user nova-compute[74075]:     <system>
Oct 26 10:30:04 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:30:04 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:30:04 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:30:04 user nova-compute[74075]:       <entry name="serial">baf14dc1-2ca0-4919-a949-3f68208dcfa6</entry>
Oct 26 10:30:04 user nova-compute[74075]:       <entry name="uuid">baf14dc1-2ca0-4919-a949-3f68208dcfa6</entry>
Oct 26 10:30:04 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:30:04 user nova-compute[74075]:     </system>
Oct 26 10:30:04 user nova-compute[74075]:   </sysinfo>
Oct 26 10:30:04 user nova-compute[74075]:   <os>
Oct 26 10:30:04 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:30:04 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:30:04 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:30:04 user nova-compute[74075]:   </os>
Oct 26 10:30:04 user nova-compute[74075]:   <features>
Oct 26 10:30:04 user nova-compute[74075]:     <acpi/>
Oct 26 10:30:04 user nova-compute[74075]:     <apic/>
Oct 26 10:30:04 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:30:04 user nova-compute[74075]:   </features>
Oct 26 10:30:04 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:30:04 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:30:04 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:30:04 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:30:04 user nova-compute[74075]:   </clock>
Oct 26 10:30:04 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:30:04 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:30:04 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:30:04 user nova-compute[74075]:   </cpu>
Oct 26 10:30:04 user nova-compute[74075]:   <devices>
Oct 26 10:30:04 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:30:04 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:30:04 user nova-compute[74075]:       <source dev="/dev/sdc"/>
Oct 26 10:30:04 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:30:04 user nova-compute[74075]:       <serial>f760d4ad-57a1-4b1d-825d-9d5a8465158e</serial>
Oct 26 10:30:04 user nova-compute[74075]:     </disk>
Oct 26 10:30:04 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:30:04 user nova-compute[74075]:       <mac address="fa:16:3e:c3:bb:1b"/>
Oct 26 10:30:04 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:30:04 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:30:04 user nova-compute[74075]:       <target dev="tap2dd25632-78"/>
Oct 26 10:30:04 user nova-compute[74075]:     </interface>
Oct 26 10:30:04 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:30:04 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/baf14dc1-2ca0-4919-a949-3f68208dcfa6/console.log" append="off"/>
Oct 26 10:30:04 user nova-compute[74075]:     </serial>
Oct 26 10:30:04 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:30:04 user nova-compute[74075]:     <video>
Oct 26 10:30:04 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:30:04 user nova-compute[74075]:     </video>
Oct 26 10:30:04 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:30:04 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:30:04 user nova-compute[74075]:     </rng>
Oct 26 10:30:04 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:30:04 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:30:04 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:30:04 user nova-compute[74075]:     </memballoon>
Oct 26 10:30:04 user nova-compute[74075]:   </devices>
Oct 26 10:30:04 user nova-compute[74075]: </domain>
Oct 26 10:30:04 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1430978455',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1430978455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1430978455',id=49,image_ref='5a2984dd-215d-459b-a558-bdec9ff1eb0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz503OSmulJBkftXm79e7EjIYb8k4EB3SgefJ3d1jM5Jiqomtjz1SX50cSPSCxZA3t7dEU3IXzdPk3o+tHFjV07rvQ8/cwxkroKMNxNYCmJx7DsWMQOCq49rZ2vsWIfjg==',key_name='tempest-keypair-318161322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-8hw746ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1296213444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=baf14dc1-2ca0-4919-a949-3f68208dcfa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG os_vif [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7179512f-4b50-597e-bc06-a77bda883412', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd25632-78, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dd25632-78, col_values=(('qos', UUID('4a08a8c9-56ba-4c68-a2b2-40fbf8c26840')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dd25632-78, col_values=(('external_ids', {'iface-id': '2dd25632-78f8-470b-850d-65dfdd40064b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:bb:1b', 'vm-uuid': 'baf14dc1-2ca0-4919-a949-3f68208dcfa6'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:04 user nova-compute[74075]: INFO os_vif [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78')
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:30:04 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No VIF found with MAC fa:16:3e:c3:bb:1b, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-21879f20-a3de-4a14-8b94-df84fbd72828 req-02da3360-5894-4991-9406-0466b002e4a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-21879f20-a3de-4a14-8b94-df84fbd72828 req-02da3360-5894-4991-9406-0466b002e4a5 service nova] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-21879f20-a3de-4a14-8b94-df84fbd72828 req-02da3360-5894-4991-9406-0466b002e4a5 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-21879f20-a3de-4a14-8b94-df84fbd72828 req-02da3360-5894-4991-9406-0466b002e4a5 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:30:06 user nova-compute[74075]: DEBUG nova.compute.manager [req-21879f20-a3de-4a14-8b94-df84fbd72828 req-02da3360-5894-4991-9406-0466b002e4a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] No waiting events found dispatching network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:30:06 user nova-compute[74075]: WARNING nova.compute.manager [req-21879f20-a3de-4a14-8b94-df84fbd72828 req-02da3360-5894-4991-9406-0466b002e4a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received unexpected event network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b for instance with vm_state building and task_state spawning.
Oct 26 10:30:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:30:08 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Instance spawned successfully.
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:30:08 user nova-compute[74075]: INFO nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Took 4.76 seconds to spawn the instance on the hypervisor.
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:30:08 user nova-compute[74075]: INFO nova.compute.manager [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Took 28.82 seconds to build instance.
Oct 26 10:30:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-988c8062-3efb-44d9-8860-7ad99744bf3c tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.929s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-6b32c4b6-f547-4fae-b116-e904d2cb66b8 req-f2c1e8ba-a419-45b9-9337-9a252456bf76 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6b32c4b6-f547-4fae-b116-e904d2cb66b8 req-f2c1e8ba-a419-45b9-9337-9a252456bf76 service nova] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6b32c4b6-f547-4fae-b116-e904d2cb66b8 req-f2c1e8ba-a419-45b9-9337-9a252456bf76 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-6b32c4b6-f547-4fae-b116-e904d2cb66b8 req-f2c1e8ba-a419-45b9-9337-9a252456bf76 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:30:08 user nova-compute[74075]: DEBUG nova.compute.manager [req-6b32c4b6-f547-4fae-b116-e904d2cb66b8 req-f2c1e8ba-a419-45b9-9337-9a252456bf76 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] No waiting events found dispatching network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:30:08 user nova-compute[74075]: WARNING nova.compute.manager [req-6b32c4b6-f547-4fae-b116-e904d2cb66b8 req-f2c1e8ba-a419-45b9-9337-9a252456bf76 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received unexpected event network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b for instance with vm_state active and task_state None.
Oct 26 10:30:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:30:42 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:30:42 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=25.155651092529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0d839e24-a856-485e-8001-6fd13684dbd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance baf14dc1-2ca0-4919-a949-3f68208dcfa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:30:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:30:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:47 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:30:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 0d839e24-a856-485e-8001-6fd13684dbd8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [{"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-0d839e24-a856-485e-8001-6fd13684dbd8" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:30:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:30:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:30:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:31:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:31:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:19 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-changed-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG nova.compute.manager [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Refreshing instance network info cache due to event network-changed-2dd25632-78f8-470b-850d-65dfdd40064b. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] Acquiring lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] Acquired lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Refreshing network info cache for port 2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updated VIF entry in instance network info cache for port 2dd25632-78f8-470b-850d-65dfdd40064b. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG nova.network.neutron [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updating instance_info_cache with network_info: [{"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-2d0f0640-562c-4aee-916c-5ac9595105a3 req-ed1196d4-ed7c-4f78-bbf4-947b3e556452 service nova] Releasing lock "refresh_cache-baf14dc1-2ca0-4919-a949-3f68208dcfa6" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:30 user nova-compute[74075]: INFO nova.compute.manager [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Terminating instance
Oct 26 10:31:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Instance destroyed successfully.
Oct 26 10:31:31 user nova-compute[74075]: DEBUG nova.objects.instance [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'resources' on Instance uuid baf14dc1-2ca0-4919-a949-3f68208dcfa6 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1430978455',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1430978455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1430978455',id=49,image_ref='5a2984dd-215d-459b-a558-bdec9ff1eb0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz503OSmulJBkftXm79e7EjIYb8k4EB3SgefJ3d1jM5Jiqomtjz1SX50cSPSCxZA3t7dEU3IXzdPk3o+tHFjV07rvQ8/cwxkroKMNxNYCmJx7DsWMQOCq49rZ2vsWIfjg==',key_name='tempest-keypair-318161322',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:30:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-8hw746ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1296213444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=baf14dc1-2ca0-4919-a949-3f68208dcfa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "2dd25632-78f8-470b-850d-65dfdd40064b", "address": "fa:16:3e:c3:bb:1b", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd25632-78", "ovs_interfaceid": "2dd25632-78f8-470b-850d-65dfdd40064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_vif [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd25632-78, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a08a8c9-56ba-4c68-a2b2-40fbf8c26840) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:31 user nova-compute[74075]: INFO os_vif [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bb:1b,bridge_name='br-int',has_traffic_filtering=True,id=2dd25632-78f8-470b-850d-65dfdd40064b,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd25632-78')
Oct 26 10:31:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFBtPgTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:31:31 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96582c0-807e-4551-ad37-24d04b45ef96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:31:31 user nova-compute[74075]: No targets found.
Oct 26 10:31:31 user nova-compute[74075]: iSNS:
Oct 26 10:31:31 user nova-compute[74075]: No targets found.
Oct 26 10:31:31 user nova-compute[74075]: STATIC:
Oct 26 10:31:31 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3
Oct 26 10:31:31 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:31:31 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:31:31 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e
Oct 26 10:31:31 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:31:31 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:31:31 user nova-compute[74075]: FIRMWARE:
Oct 26 10:31:31 user nova-compute[74075]: No targets found.
Oct 26 10:31:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:31:31 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:31:31 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a6f45b-c4d7-4856-95ed-c3cb4960ad72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[32befe5d-970f-41be-9f7b-5a44b65dd7b2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:31:31 user nova-compute[74075]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e (non-flash)
Oct 26 10:31:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:31:31 user nova-compute[74075]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e (non-flash)
Oct 26 10:31:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c145360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1883071-09bc-4241-a9ad-2d5c2ddcfe29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c853f2-1067-4c29-b2cb-8bee3cb14f38]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e3d9c-25b3-44c8-bf88-122367432656]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[454de805-7615-4d10-a59d-e002140948ae]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23033353832316234', '/dev/disk/by-id/scsi-1SCST_BIOe106d34f-035821b49f125787', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e106d34f') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf871caf-1060-4008-8054-c721694909e4]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b1b82-604d-4e92-a27f-eabc4ab136e9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[935adf55-afbf-455c-b7b1-7de50e85e479]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260]
Oct 26 10:31:31 user nova-compute[74075]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e, portal: 172.16.0.220,3260] successful.
Oct 26 10:31:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f760d4ad-57a1-4b1d-825d-9d5a8465158e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a4eb1c-1500-4dad-bd5b-083866f19143]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== disconnect_volume: return (318ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:31:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:31:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Deleting instance files /opt/stack/data/nova/instances/baf14dc1-2ca0-4919-a949-3f68208dcfa6_del
Oct 26 10:31:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Deletion of /opt/stack/data/nova/instances/baf14dc1-2ca0-4919-a949-3f68208dcfa6_del complete
Oct 26 10:31:32 user nova-compute[74075]: INFO nova.compute.manager [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-vif-unplugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] No waiting events found dispatching network-vif-unplugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-vif-unplugged-2dd25632-78f8-470b-850d-65dfdd40064b for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] Acquiring lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] No waiting events found dispatching network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:31:32 user nova-compute[74075]: WARNING nova.compute.manager [req-b2d883bf-b1b0-4b53-bbb8-e3af26671252 req-a16ddfd7-1a78-4033-8e92-4a108fa736a5 service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received unexpected event network-vif-plugged-2dd25632-78f8-470b-850d-65dfdd40064b for instance with vm_state active and task_state deleting.
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:31:32 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Took 0.64 seconds to deallocate network for instance.
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-22be0771-8e55-47ae-9583-7ecd10eca789 req-5665c0ea-bb6c-4ac2-b814-c5833d3d653d service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Received event network-vif-deleted-2dd25632-78f8-470b-850d-65dfdd40064b {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:31:32 user nova-compute[74075]: INFO nova.compute.manager [req-22be0771-8e55-47ae-9583-7ecd10eca789 req-5665c0ea-bb6c-4ac2-b814-c5833d3d653d service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Neutron deleted interface 2dd25632-78f8-470b-850d-65dfdd40064b; detaching it from the instance and deleting it from the info cache
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.network.neutron [req-22be0771-8e55-47ae-9583-7ecd10eca789 req-5665c0ea-bb6c-4ac2-b814-c5833d3d653d service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:31:32 user nova-compute[74075]: DEBUG nova.compute.manager [req-22be0771-8e55-47ae-9583-7ecd10eca789 req-5665c0ea-bb6c-4ac2-b814-c5833d3d653d service nova] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Detach interface failed, port_id=2dd25632-78f8-470b-850d-65dfdd40064b, reason: Instance baf14dc1-2ca0-4919-a949-3f68208dcfa6 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 10:31:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:33 user nova-compute[74075]: INFO nova.compute.manager [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Took 0.97 seconds to detach 1 volumes for instance.
Oct 26 10:31:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: baf14dc1-2ca0-4919-a949-3f68208dcfa6] Deleting volume: f760d4ad-57a1-4b1d-825d-9d5a8465158e {{(pid=74075) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 10:31:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:33 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:31:33 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:31:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:33 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Deleted allocations for instance baf14dc1-2ca0-4919-a949-3f68208dcfa6
Oct 26 10:31:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-f2d75e11-9f4e-44a8-a97e-c7c7636dc5b2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "baf14dc1-2ca0-4919-a949-3f68208dcfa6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.171s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:31:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:31:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.15475082397461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 0d839e24-a856-485e-8001-6fd13684dbd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:31:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:31:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:31:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:31:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:31:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:31:52 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:31:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:31:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:31:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Triggering sync for uuid 0d839e24-a856-485e-8001-6fd13684dbd8 {{(pid=74075) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 10:32:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "0d839e24-a856-485e-8001-6fd13684dbd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:07 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "0d839e24-a856-485e-8001-6fd13684dbd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:32:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:32:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:32:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:32:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "0d839e24-a856-485e-8001-6fd13684dbd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:30 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:30 user nova-compute[74075]: INFO nova.compute.manager [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Terminating instance
Oct 26 10:32:30 user nova-compute[74075]: DEBUG nova.compute.manager [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:32:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-1f2a7226-e511-4c5e-a272-514928dae516 req-6167db5a-aeb9-431f-8891-d00baf506646 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-vif-unplugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1f2a7226-e511-4c5e-a272-514928dae516 req-6167db5a-aeb9-431f-8891-d00baf506646 service nova] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1f2a7226-e511-4c5e-a272-514928dae516 req-6167db5a-aeb9-431f-8891-d00baf506646 service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1f2a7226-e511-4c5e-a272-514928dae516 req-6167db5a-aeb9-431f-8891-d00baf506646 service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-1f2a7226-e511-4c5e-a272-514928dae516 req-6167db5a-aeb9-431f-8891-d00baf506646 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] No waiting events found dispatching network-vif-unplugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.compute.manager [req-1f2a7226-e511-4c5e-a272-514928dae516 req-6167db5a-aeb9-431f-8891-d00baf506646 service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-vif-unplugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Instance destroyed successfully.
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.objects.instance [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'resources' on Instance uuid 0d839e24-a856-485e-8001-6fd13684dbd8 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:27:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1998461543',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1998461543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1998461543',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyIe70tNAYRHijeGb9sNrWdQgZP5qC5PvsUjGZUC7Q/+xm3kE5TnhMfvxABwcaPZQOo9tWXWVRWp2NIAiSWKq2oCGEa9XOMlY03+rGSATTL8K3Q1oM2bWLQ4E70L29ClQ==',key_name='tempest-keypair-2129321058',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-wf3er7c7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=0d839e24-a856-485e-8001-6fd13684dbd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "address": "fa:16:3e:97:57:5a", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1d4ff9-47", "ovs_interfaceid": "df1d4ff9-4774-47e7-b6ba-0fc6e323ae13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_vif [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf1d4ff9-47, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e7f958e-2db5-4947-880a-a74dc7486af2) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:32:31 user nova-compute[74075]: INFO os_vif [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:57:5a,bridge_name='br-int',has_traffic_filtering=True,id=df1d4ff9-4774-47e7-b6ba-0fc6e323ae13,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1d4ff9-47')
Oct 26 10:32:31 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muXvdhSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:32:31 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9f0fdb-da2c-4866-8f3c-8d55168fdcb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:32:31 user nova-compute[74075]: No targets found.
Oct 26 10:32:31 user nova-compute[74075]: iSNS:
Oct 26 10:32:31 user nova-compute[74075]: No targets found.
Oct 26 10:32:31 user nova-compute[74075]: STATIC:
Oct 26 10:32:31 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3
Oct 26 10:32:31 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:32:31 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:32:31 user nova-compute[74075]: FIRMWARE:
Oct 26 10:32:31 user nova-compute[74075]: No targets found.
Oct 26 10:32:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:32:31 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:32:31 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[30963533-e7e8-4299-9f3a-07bd10619841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb636cf-a1a7-496b-bb75-a148912050d6]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:32:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 (non-flash)
Oct 26 10:32:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c280e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b23df-65fa-4950-a57b-b12ddae38628]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f6406a-0bb0-44cc-9378-edcd11218f5f]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7b067-7685-40b5-9205-c34e73168211]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b6e17-395c-497e-8505-62a6ad968cae]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23836646435366431', '/dev/disk/by-id/scsi-1SCST_BIOde110e0b-86dd56d1ba4349ca', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_de110e0b') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff05f6-609c-4d06-a9a6-af7f31e0607d]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe200a-27a5-4ef0-83fb-5604daf7f7fc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7356dc-f3d4-455f-8714-45da2578bdfd]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260]
Oct 26 10:32:31 user nova-compute[74075]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3, portal: 172.16.0.220,3260] successful.
Oct 26 10:32:31 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:32:31 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4becb9f8-2252-4707-9a9b-c20e990d0fd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5687cac-9402-4558-8913-19b7e20bb8e1]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== disconnect_volume: return (297ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:32:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Deleting instance files /opt/stack/data/nova/instances/0d839e24-a856-485e-8001-6fd13684dbd8_del
Oct 26 10:32:32 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Deletion of /opt/stack/data/nova/instances/0d839e24-a856-485e-8001-6fd13684dbd8_del complete
Oct 26 10:32:32 user nova-compute[74075]: INFO nova.compute.manager [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 26 10:32:32 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:32 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:32:32 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Took 0.63 seconds to deallocate network for instance.
Oct 26 10:32:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] Acquiring lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] Lock "0d839e24-a856-485e-8001-6fd13684dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] No waiting events found dispatching network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:32:33 user nova-compute[74075]: WARNING nova.compute.manager [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received unexpected event network-vif-plugged-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 for instance with vm_state active and task_state deleting.
Oct 26 10:32:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-0689fe90-02f2-44fb-9215-70e25308a5fd req-e1af5931-4d10-4fb4-915c-437696c007fa service nova] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Received event network-vif-deleted-df1d4ff9-4774-47e7-b6ba-0fc6e323ae13 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:32:33 user nova-compute[74075]: INFO nova.compute.manager [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Took 0.81 seconds to detach 1 volumes for instance.
Oct 26 10:32:33 user nova-compute[74075]: DEBUG nova.compute.manager [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 0d839e24-a856-485e-8001-6fd13684dbd8] Deleting volume: 4becb9f8-2252-4707-9a9b-c20e990d0fd3 {{(pid=74075) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:33 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Deleted allocations for instance 0d839e24-a856-485e-8001-6fd13684dbd8
Oct 26 10:32:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-41a1621e-1c79-4727-9ff5-04c678691999 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "0d839e24-a856-485e-8001-6fd13684dbd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.923s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:32:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:32:43 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9051MB free_disk=25.153915405273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:32:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:32:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:32:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:32:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:32:54 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:32:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:32:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:32:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:33:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:33:22 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:33:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:33:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:33:40 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:33:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:33:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:33:40 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:33:40 user nova-compute[74075]: INFO nova.compute.claims [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Claim successful on node user
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.179s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:33:41 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:33:41 user nova-compute[74075]: INFO nova.virt.block_device [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Booting with volume 49d18dc9-fd2a-429d-9eec-d7f5a33dc30d at /dev/vda
Oct 26 10:33:41 user nova-compute[74075]: DEBUG os_brick.utils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5246f27-a5c1-4be2-8c44-4c9abfac52d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2188d24c-7563-4dc5-a5d6-aa863cb1c4e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461afa4-4f6d-42cd-a8df-e5c100e34479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed59c6-7e50-4c04-8f21-920ae4dd8012]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.policy [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f870a45d74547d6ae2ce1395e2d1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd24b2446a4777af68ec4dea66f6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:33:41 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:33:41 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe07e6f-6d4c-4b09-9575-334dfaad52db]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG os_brick.utils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating existing volume attachment record: c4fc6949-ea64-46e0-951a-9f90ec55399e {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:33:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Successfully created port: e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Successfully updated port: e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquired lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-changed-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG nova.compute.manager [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Refreshing instance network info cache due to event network-changed-e256a02d-5c10-4990-be24-d297fdda87d4. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:33:42 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] Acquiring lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG nova.network.neutron [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating instance_info_cache with network_info: [{"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Releasing lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Instance network_info: |[{"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] Acquired lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Refreshing network info cache for port e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updated VIF entry in instance network info cache for port e256a02d-5c10-4990-be24-d297fdda87d4. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG nova.network.neutron [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating instance_info_cache with network_info: [{"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:33:43 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-8d5c7c1c-3659-4331-88b0-0c4e2888daf2 req-bbdbc0a2-2fcb-480d-b942-2132259ae115 service nova] Releasing lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:33:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:33:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=25.144664764404297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b5f4497d-ddc2-4500-a3bc-85d9bd362b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:33:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:33:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:33:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:50 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:33:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:33:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Skipping network cache update for instance because it is Building. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 10:33:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:33:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:33:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:33:58 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Creating image(s)
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Ensure instance console log exists: /opt/stack/data/nova/instances/b5f4497d-ddc2-4500-a3bc-85d9bd362b06/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Start _get_guest_xml network_info=[{"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'c4fc6949-ea64-46e0-951a-9f90ec55399e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5f4497d-ddc2-4500-a3bc-85d9bd362b06', 'attached_at': '', 'detached_at': '', 'volume_id': '49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'serial': '49d18dc9-fd2a-429d-9eec-d7f5a33dc30d'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:33:58 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:33:58 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:33:58 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:33:58 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:33:58 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f46251-d38f-427a-b6ef-b224d5b5a12b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:33:58 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a878d3-19d7-4309-af7d-43c06f5d43e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d] added
Oct 26 10:33:58 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39ed219-e261-41b3-944b-bb42466ad061]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[968630d2-3517-4af0-92f1-873a7378d58c]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzsFaMAI {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzsFaMAI" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e002f1e-48b1-4c9a-95f0-fd7364b90678]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzsFaMAI'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5c68f7-1236-4ebd-ae0a-569d356635cc]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b22d1-d437-4e61-82c3-a5b530081a24]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:33:58 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:33:58 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:33:58 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:33:58 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:33:58 user nova-compute[74075]: 
Oct 26 10:33:58 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f447d6d3-d8bf-42b9-841e-07d376344507]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]
Oct 26 10:33:59 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.
Oct 26 10:33:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf2d4a-2d8e-4901-89ad-8b2687704b68]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3005f-45c6-4b38-899d-8c54df4ff79f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:33:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:33:59 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[be20ca55-e32c-490e-93c7-408d0a83bd04]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:33:59 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23863303532303762', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863303532303762', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1744566861',display_name='tempest-TestVolumeBootPattern-server-1744566861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1744566861',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-a9x29ala',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:33:41Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=b5f4497d-ddc2-4500-a3bc-85d9bd362b06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'pci_devices' on Instance uuid b5f4497d-ddc2-4500-a3bc-85d9bd362b06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:34:00 user nova-compute[74075]:   <uuid>b5f4497d-ddc2-4500-a3bc-85d9bd362b06</uuid>
Oct 26 10:34:00 user nova-compute[74075]:   <name>instance-00000032</name>
Oct 26 10:34:00 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:34:00 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:34:00 user nova-compute[74075]:   <metadata>
Oct 26 10:34:00 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:34:00 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:34:00 user nova-compute[74075]:       <nova:name>tempest-TestVolumeBootPattern-server-1744566861</nova:name>
Oct 26 10:34:00 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:33:58</nova:creationTime>
Oct 26 10:34:00 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:34:00 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:34:00 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:34:00 user nova-compute[74075]:       <nova:owner>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:user uuid="2f870a45d74547d6ae2ce1395e2d1588">tempest-TestVolumeBootPattern-1296213444-project-member</nova:user>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:project uuid="f8dd24b2446a4777af68ec4dea66f6c7">tempest-TestVolumeBootPattern-1296213444</nova:project>
Oct 26 10:34:00 user nova-compute[74075]:       </nova:owner>
Oct 26 10:34:00 user nova-compute[74075]:       <nova:ports>
Oct 26 10:34:00 user nova-compute[74075]:         <nova:port uuid="e256a02d-5c10-4990-be24-d297fdda87d4">
Oct 26 10:34:00 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 10:34:00 user nova-compute[74075]:         </nova:port>
Oct 26 10:34:00 user nova-compute[74075]:       </nova:ports>
Oct 26 10:34:00 user nova-compute[74075]:     </nova:instance>
Oct 26 10:34:00 user nova-compute[74075]:   </metadata>
Oct 26 10:34:00 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:34:00 user nova-compute[74075]:     <system>
Oct 26 10:34:00 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:34:00 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:34:00 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:34:00 user nova-compute[74075]:       <entry name="serial">b5f4497d-ddc2-4500-a3bc-85d9bd362b06</entry>
Oct 26 10:34:00 user nova-compute[74075]:       <entry name="uuid">b5f4497d-ddc2-4500-a3bc-85d9bd362b06</entry>
Oct 26 10:34:00 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:34:00 user nova-compute[74075]:     </system>
Oct 26 10:34:00 user nova-compute[74075]:   </sysinfo>
Oct 26 10:34:00 user nova-compute[74075]:   <os>
Oct 26 10:34:00 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:34:00 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:34:00 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:34:00 user nova-compute[74075]:   </os>
Oct 26 10:34:00 user nova-compute[74075]:   <features>
Oct 26 10:34:00 user nova-compute[74075]:     <acpi/>
Oct 26 10:34:00 user nova-compute[74075]:     <apic/>
Oct 26 10:34:00 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:34:00 user nova-compute[74075]:   </features>
Oct 26 10:34:00 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:34:00 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:34:00 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:34:00 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:34:00 user nova-compute[74075]:   </clock>
Oct 26 10:34:00 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:34:00 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:34:00 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:34:00 user nova-compute[74075]:   </cpu>
Oct 26 10:34:00 user nova-compute[74075]:   <devices>
Oct 26 10:34:00 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:34:00 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:34:00 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 10:34:00 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:34:00 user nova-compute[74075]:       <serial>49d18dc9-fd2a-429d-9eec-d7f5a33dc30d</serial>
Oct 26 10:34:00 user nova-compute[74075]:     </disk>
Oct 26 10:34:00 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:34:00 user nova-compute[74075]:       <mac address="fa:16:3e:0e:ac:26"/>
Oct 26 10:34:00 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:34:00 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:34:00 user nova-compute[74075]:       <target dev="tape256a02d-5c"/>
Oct 26 10:34:00 user nova-compute[74075]:     </interface>
Oct 26 10:34:00 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:34:00 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/b5f4497d-ddc2-4500-a3bc-85d9bd362b06/console.log" append="off"/>
Oct 26 10:34:00 user nova-compute[74075]:     </serial>
Oct 26 10:34:00 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:34:00 user nova-compute[74075]:     <video>
Oct 26 10:34:00 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:34:00 user nova-compute[74075]:     </video>
Oct 26 10:34:00 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:34:00 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:34:00 user nova-compute[74075]:     </rng>
Oct 26 10:34:00 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:34:00 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:34:00 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:34:00 user nova-compute[74075]:     </memballoon>
Oct 26 10:34:00 user nova-compute[74075]:   </devices>
Oct 26 10:34:00 user nova-compute[74075]: </domain>
Oct 26 10:34:00 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1744566861',display_name='tempest-TestVolumeBootPattern-server-1744566861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1744566861',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-a9x29ala',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:33:41Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=b5f4497d-ddc2-4500-a3bc-85d9bd362b06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG os_vif [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df52a23e-bed3-5271-a5d3-d785e5cca158', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape256a02d-5c, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape256a02d-5c, col_values=(('qos', UUID('ed32b9be-4cc9-4a26-9a43-bc16f3ea657f')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape256a02d-5c, col_values=(('external_ids', {'iface-id': 'e256a02d-5c10-4990-be24-d297fdda87d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ac:26', 'vm-uuid': 'b5f4497d-ddc2-4500-a3bc-85d9bd362b06'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:00 user nova-compute[74075]: INFO os_vif [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c')
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:34:00 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No VIF found with MAC fa:16:3e:0e:ac:26, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-f1e1e50d-e322-4106-b9d2-eb3f5bffaa34 req-543dd339-cce7-40bb-878f-73a5d47c36e7 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f1e1e50d-e322-4106-b9d2-eb3f5bffaa34 req-543dd339-cce7-40bb-878f-73a5d47c36e7 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f1e1e50d-e322-4106-b9d2-eb3f5bffaa34 req-543dd339-cce7-40bb-878f-73a5d47c36e7 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f1e1e50d-e322-4106-b9d2-eb3f5bffaa34 req-543dd339-cce7-40bb-878f-73a5d47c36e7 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:34:01 user nova-compute[74075]: DEBUG nova.compute.manager [req-f1e1e50d-e322-4106-b9d2-eb3f5bffaa34 req-543dd339-cce7-40bb-878f-73a5d47c36e7 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:34:01 user nova-compute[74075]: WARNING nova.compute.manager [req-f1e1e50d-e322-4106-b9d2-eb3f5bffaa34 req-543dd339-cce7-40bb-878f-73a5d47c36e7 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received unexpected event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with vm_state building and task_state spawning.
Oct 26 10:34:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:02 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:34:03 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Instance spawned successfully.
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:34:03 user nova-compute[74075]: INFO nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Took 4.93 seconds to spawn the instance on the hypervisor.
Oct 26 10:34:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:34:03 user nova-compute[74075]: INFO nova.compute.manager [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Took 22.81 seconds to build instance.
Oct 26 10:34:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a2992d21-e487-4f8d-916a-738c5aaec8a0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.906s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:34:04 user nova-compute[74075]: DEBUG nova.compute.manager [req-f99dc937-da32-4cbf-a0b1-4db22d749dc7 req-d7ce530a-a60e-452f-b4d4-7f3c580ce3ee service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:34:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f99dc937-da32-4cbf-a0b1-4db22d749dc7 req-d7ce530a-a60e-452f-b4d4-7f3c580ce3ee service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:34:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f99dc937-da32-4cbf-a0b1-4db22d749dc7 req-d7ce530a-a60e-452f-b4d4-7f3c580ce3ee service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:34:04 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-f99dc937-da32-4cbf-a0b1-4db22d749dc7 req-d7ce530a-a60e-452f-b4d4-7f3c580ce3ee service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:34:04 user nova-compute[74075]: DEBUG nova.compute.manager [req-f99dc937-da32-4cbf-a0b1-4db22d749dc7 req-d7ce530a-a60e-452f-b4d4-7f3c580ce3ee service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:34:04 user nova-compute[74075]: WARNING nova.compute.manager [req-f99dc937-da32-4cbf-a0b1-4db22d749dc7 req-d7ce530a-a60e-452f-b4d4-7f3c580ce3ee service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received unexpected event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with vm_state active and task_state None.
Oct 26 10:34:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:34:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:34:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:34:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:34:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:34:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:34:45 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.23038101196289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance b5f4497d-ddc2-4500-a3bc-85d9bd362b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:34:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:34:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:34:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:34:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid b5f4497d-ddc2-4500-a3bc-85d9bd362b06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating instance_info_cache with network_info: [{"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:34:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:32 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-changed-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:33 user nova-compute[74075]: DEBUG nova.compute.manager [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Refreshing instance network info cache due to event network-changed-e256a02d-5c10-4990-be24-d297fdda87d4. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] Acquiring lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:35:33 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] Acquired lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:35:33 user nova-compute[74075]: DEBUG nova.network.neutron [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Refreshing network info cache for port e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:35:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updated VIF entry in instance network info cache for port e256a02d-5c10-4990-be24-d297fdda87d4. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:35:34 user nova-compute[74075]: DEBUG nova.network.neutron [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating instance_info_cache with network_info: [{"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:35:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-79c5d79e-2a8b-4869-9513-92764abd2171 req-ece097b3-df98-4f07-a6c2-983922f38913 service nova] Releasing lock "refresh_cache-b5f4497d-ddc2-4500-a3bc-85d9bd362b06" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:35 user nova-compute[74075]: INFO nova.compute.manager [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Terminating instance
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e9db3cc-d6eb-41cf-9737-acb073e63e96 req-74b20950-5f37-46de-ae67-bed5885e26d1 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-unplugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e9db3cc-d6eb-41cf-9737-acb073e63e96 req-74b20950-5f37-46de-ae67-bed5885e26d1 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e9db3cc-d6eb-41cf-9737-acb073e63e96 req-74b20950-5f37-46de-ae67-bed5885e26d1 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1e9db3cc-d6eb-41cf-9737-acb073e63e96 req-74b20950-5f37-46de-ae67-bed5885e26d1 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e9db3cc-d6eb-41cf-9737-acb073e63e96 req-74b20950-5f37-46de-ae67-bed5885e26d1 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-unplugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.compute.manager [req-1e9db3cc-d6eb-41cf-9737-acb073e63e96 req-74b20950-5f37-46de-ae67-bed5885e26d1 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-unplugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Instance destroyed successfully.
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.objects.instance [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'resources' on Instance uuid b5f4497d-ddc2-4500-a3bc-85d9bd362b06 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1744566861',display_name='tempest-TestVolumeBootPattern-server-1744566861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1744566861',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:34:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-a9x29ala',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:34:04Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=b5f4497d-ddc2-4500-a3bc-85d9bd362b06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "e256a02d-5c10-4990-be24-d297fdda87d4", "address": "fa:16:3e:0e:ac:26", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape256a02d-5c", "ovs_interfaceid": "e256a02d-5c10-4990-be24-d297fdda87d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:35:35 user nova-compute[74075]: DEBUG os_vif [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape256a02d-5c, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed32b9be-4cc9-4a26-9a43-bc16f3ea657f) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: INFO os_vif [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ac:26,bridge_name='br-int',has_traffic_filtering=True,id=e256a02d-5c10-4990-be24-d297fdda87d4,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape256a02d-5c')
Oct 26 10:35:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:35:36 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a88e9-fde8-4248-b9c5-956ba4b3db9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:35:36 user nova-compute[74075]: No targets found.
Oct 26 10:35:36 user nova-compute[74075]: iSNS:
Oct 26 10:35:36 user nova-compute[74075]: No targets found.
Oct 26 10:35:36 user nova-compute[74075]: STATIC:
Oct 26 10:35:36 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d
Oct 26 10:35:36 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:35:36 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:35:36 user nova-compute[74075]: FIRMWARE:
Oct 26 10:35:36 user nova-compute[74075]: No targets found.
Oct 26 10:35:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:35:36 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:35:36 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c813bbb4-a982-4c75-a714-b2e64135f781]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03cd117-439f-405f-b496-ac61763095d9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:35:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:35:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c2e0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22772c1-3e17-450a-a70a-b831fdcad6d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70e805-f8b2-4c21-8a38-e9bc2a9018e1]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[55876727-1449-4099-907c-03e55bcbebb7]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e73d29d-d4df-4e0e-adf2-e11c247436be]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_44765067', '/dev/disk/by-id/scsi-1SCST_BIO44765067-8c05207bfbdaff8f', '/dev/disk/by-id/scsi-23863303532303762') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[688830b1-56f2-4231-ac8e-8304b22fa28f]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e24172-97f7-4859-9f48-29c1ee8975de]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e845d-00b5-401e-afa2-9da8a24112e0]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]
Oct 26 10:35:36 user nova-compute[74075]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.
Oct 26 10:35:36 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f999742-675d-49b4-b56c-4d3c8505ff2b]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== disconnect_volume: return (330ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:35:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Deleting instance files /opt/stack/data/nova/instances/b5f4497d-ddc2-4500-a3bc-85d9bd362b06_del
Oct 26 10:35:36 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Deletion of /opt/stack/data/nova/instances/b5f4497d-ddc2-4500-a3bc-85d9bd362b06_del complete
Oct 26 10:35:36 user nova-compute[74075]: INFO nova.compute.manager [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 26 10:35:36 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:35:37 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Took 0.76 seconds to deallocate network for instance.
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-c30df258-4589-4d5f-97c8-62410a7230db req-4b9bf4ee-5a59-4f07-8ec9-6934542ef312 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-deleted-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:37 user nova-compute[74075]: INFO nova.compute.manager [req-c30df258-4589-4d5f-97c8-62410a7230db req-4b9bf4ee-5a59-4f07-8ec9-6934542ef312 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Neutron deleted interface e256a02d-5c10-4990-be24-d297fdda87d4; detaching it from the instance and deleting it from the info cache
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-c30df258-4589-4d5f-97c8-62410a7230db req-4b9bf4ee-5a59-4f07-8ec9-6934542ef312 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-c30df258-4589-4d5f-97c8-62410a7230db req-4b9bf4ee-5a59-4f07-8ec9-6934542ef312 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Detach interface failed, port_id=e256a02d-5c10-4990-be24-d297fdda87d4, reason: Instance b5f4497d-ddc2-4500-a3bc-85d9bd362b06 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:35:37 user nova-compute[74075]: WARNING nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received unexpected event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with vm_state active and task_state deleting.
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:35:37 user nova-compute[74075]: WARNING nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received unexpected event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with vm_state active and task_state deleting.
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:35:37 user nova-compute[74075]: WARNING nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received unexpected event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with vm_state active and task_state deleting.
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-unplugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-unplugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-unplugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Acquiring lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:37 user nova-compute[74075]: DEBUG nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] No waiting events found dispatching network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:35:37 user nova-compute[74075]: WARNING nova.compute.manager [req-b738257a-2876-47de-a87c-81f9c58b140f req-b4610127-f187-4563-8130-200c9420b1d5 service nova] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Received unexpected event network-vif-plugged-e256a02d-5c10-4990-be24-d297fdda87d4 for instance with vm_state active and task_state deleting.
Oct 26 10:35:38 user nova-compute[74075]: INFO nova.compute.manager [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: b5f4497d-ddc2-4500-a3bc-85d9bd362b06] Took 0.82 seconds to detach 1 volumes for instance.
Oct 26 10:35:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:38 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:35:38 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:35:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:38 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Deleted allocations for instance b5f4497d-ddc2-4500-a3bc-85d9bd362b06
Oct 26 10:35:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-a0899b2d-70ff-4324-a29e-12b3fc113baf tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "b5f4497d-ddc2-4500-a3bc-85d9bd362b06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:35:47 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:35:47 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.011524200439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:35:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:51 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:35:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:35:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:35:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:35:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:35:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:35:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:35:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:01 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:06 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:36:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:36:11 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:36:16 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:21 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "37319bfd-438b-495a-93a4-bc7e475f6533" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:26 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:36:26 user nova-compute[74075]: INFO nova.compute.claims [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Claim successful on node user
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:36:27 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.policy [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f870a45d74547d6ae2ce1395e2d1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd24b2446a4777af68ec4dea66f6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:36:27 user nova-compute[74075]: INFO nova.virt.block_device [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Booting with volume 49d18dc9-fd2a-429d-9eec-d7f5a33dc30d at /dev/vda
Oct 26 10:36:27 user nova-compute[74075]: DEBUG os_brick.utils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[db954efe-b80d-46c2-a2b0-f38a6b44e77b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31920af-ffdd-49a7-8a30-c5ae36501c20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212d953-d822-4343-a5c7-205d408fb70e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d16b6b-62d1-4458-a55f-fd94f64b9da6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:36:27 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:36:27 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f127f5c3-3dcc-4648-9679-c9a312e7a434]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG os_brick.utils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating existing volume attachment record: df762050-77f6-4ac0-a667-fe4cf8d26477 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:36:27 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Successfully created port: 87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Successfully updated port: 87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-changed-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.compute.manager [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Refreshing instance network info cache due to event network-changed-87ec4691-6c02-493b-b6de-9ef9d5e5f644. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.network.neutron [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Instance network_info: |[{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:36:28 user nova-compute[74075]: DEBUG nova.network.neutron [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Refreshing network info cache for port 87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:36:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated VIF entry in instance network info cache for port 87ec4691-6c02-493b-b6de-9ef9d5e5f644. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:36:29 user nova-compute[74075]: DEBUG nova.network.neutron [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:36:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-66806d76-0dcf-408d-b05d-6c1653f293d8 req-66a93b67-6901-49dc-bc88-92b2fb3a60a6 service nova] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:36:31 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:36 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:41 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:36:44 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Creating image(s)
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Ensure instance console log exists: /opt/stack/data/nova/instances/37319bfd-438b-495a-93a4-bc7e475f6533/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Start _get_guest_xml network_info=[{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'df762050-77f6-4ac0-a667-fe4cf8d26477', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37319bfd-438b-495a-93a4-bc7e475f6533', 'attached_at': '', 'detached_at': '', 'volume_id': '49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'serial': '49d18dc9-fd2a-429d-9eec-d7f5a33dc30d'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:36:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:36:44 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:36:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:36:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:36:44 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e45d73-9b4b-43f4-a972-6d504d5e02cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:36:44 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9261521-ca03-4208-b2ca-00f89ebe2f15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d] added
Oct 26 10:36:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd03dc-a537-4e28-9c1f-64bc4854921d]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f264630-e1ad-490d-aaf9-8e8f367796b6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzsFaMAI {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzsFaMAI" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a3239-f1df-4ed7-bd89-d4050c3d95f9]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzsFaMAI'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9ac4a4-8920-40a6-9ef2-6cfb0016eb17]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9dbfb-4260-496e-bc50-6b18b8c38f98]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:36:44 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 10:36:44 user nova-compute[74075]:  {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:36:44 user nova-compute[74075]: WARNING os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 10:36:44 user nova-compute[74075]: 
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dd9782-da16-4b05-86d7-fc54ea0ad21f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]
Oct 26 10:36:44 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.
Oct 26 10:36:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e3ce4-a2e8-4e71-a76e-978aa6cf8f5f]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0219aac3-5272-44d5-97db-15f89d5e0842]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:36:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:36:44 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84c105f-8fbe-4838-9e21-0add64829d68]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:36:44 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23863303532303762', 'path': '/dev/sdb'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863303532303762', 'path': '/dev/sdb'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-115408278',display_name='tempest-TestVolumeBootPattern-server-115408278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-115408278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-wp48uudm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:36:27Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=37319bfd-438b-495a-93a4-bc7e475f6533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.objects.instance [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'pci_devices' on Instance uuid 37319bfd-438b-495a-93a4-bc7e475f6533 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:36:45 user nova-compute[74075]:   <uuid>37319bfd-438b-495a-93a4-bc7e475f6533</uuid>
Oct 26 10:36:45 user nova-compute[74075]:   <name>instance-00000033</name>
Oct 26 10:36:45 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:36:45 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:36:45 user nova-compute[74075]:   <metadata>
Oct 26 10:36:45 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:36:45 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:36:45 user nova-compute[74075]:       <nova:name>tempest-TestVolumeBootPattern-server-115408278</nova:name>
Oct 26 10:36:45 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:36:44</nova:creationTime>
Oct 26 10:36:45 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:36:45 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:36:45 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:36:45 user nova-compute[74075]:       <nova:owner>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:user uuid="2f870a45d74547d6ae2ce1395e2d1588">tempest-TestVolumeBootPattern-1296213444-project-member</nova:user>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:project uuid="f8dd24b2446a4777af68ec4dea66f6c7">tempest-TestVolumeBootPattern-1296213444</nova:project>
Oct 26 10:36:45 user nova-compute[74075]:       </nova:owner>
Oct 26 10:36:45 user nova-compute[74075]:       <nova:ports>
Oct 26 10:36:45 user nova-compute[74075]:         <nova:port uuid="87ec4691-6c02-493b-b6de-9ef9d5e5f644">
Oct 26 10:36:45 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 10:36:45 user nova-compute[74075]:         </nova:port>
Oct 26 10:36:45 user nova-compute[74075]:       </nova:ports>
Oct 26 10:36:45 user nova-compute[74075]:     </nova:instance>
Oct 26 10:36:45 user nova-compute[74075]:   </metadata>
Oct 26 10:36:45 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:36:45 user nova-compute[74075]:     <system>
Oct 26 10:36:45 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:36:45 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:36:45 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:36:45 user nova-compute[74075]:       <entry name="serial">37319bfd-438b-495a-93a4-bc7e475f6533</entry>
Oct 26 10:36:45 user nova-compute[74075]:       <entry name="uuid">37319bfd-438b-495a-93a4-bc7e475f6533</entry>
Oct 26 10:36:45 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:36:45 user nova-compute[74075]:     </system>
Oct 26 10:36:45 user nova-compute[74075]:   </sysinfo>
Oct 26 10:36:45 user nova-compute[74075]:   <os>
Oct 26 10:36:45 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:36:45 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:36:45 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:36:45 user nova-compute[74075]:   </os>
Oct 26 10:36:45 user nova-compute[74075]:   <features>
Oct 26 10:36:45 user nova-compute[74075]:     <acpi/>
Oct 26 10:36:45 user nova-compute[74075]:     <apic/>
Oct 26 10:36:45 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:36:45 user nova-compute[74075]:   </features>
Oct 26 10:36:45 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:36:45 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:36:45 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:36:45 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:36:45 user nova-compute[74075]:   </clock>
Oct 26 10:36:45 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:36:45 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:36:45 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:36:45 user nova-compute[74075]:   </cpu>
Oct 26 10:36:45 user nova-compute[74075]:   <devices>
Oct 26 10:36:45 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:36:45 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:36:45 user nova-compute[74075]:       <source dev="/dev/sdb"/>
Oct 26 10:36:45 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:36:45 user nova-compute[74075]:       <serial>49d18dc9-fd2a-429d-9eec-d7f5a33dc30d</serial>
Oct 26 10:36:45 user nova-compute[74075]:     </disk>
Oct 26 10:36:45 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:36:45 user nova-compute[74075]:       <mac address="fa:16:3e:12:7b:60"/>
Oct 26 10:36:45 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:36:45 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:36:45 user nova-compute[74075]:       <target dev="tap87ec4691-6c"/>
Oct 26 10:36:45 user nova-compute[74075]:     </interface>
Oct 26 10:36:45 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:36:45 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/37319bfd-438b-495a-93a4-bc7e475f6533/console.log" append="off"/>
Oct 26 10:36:45 user nova-compute[74075]:     </serial>
Oct 26 10:36:45 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:36:45 user nova-compute[74075]:     <video>
Oct 26 10:36:45 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:36:45 user nova-compute[74075]:     </video>
Oct 26 10:36:45 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:36:45 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:36:45 user nova-compute[74075]:     </rng>
Oct 26 10:36:45 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:36:45 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:36:45 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:36:45 user nova-compute[74075]:     </memballoon>
Oct 26 10:36:45 user nova-compute[74075]:   </devices>
Oct 26 10:36:45 user nova-compute[74075]: </domain>
Oct 26 10:36:45 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-115408278',display_name='tempest-TestVolumeBootPattern-server-115408278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-115408278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-wp48uudm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:36:27Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=37319bfd-438b-495a-93a4-bc7e475f6533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG os_vif [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7409736e-867d-5097-a6f7-54b477bf3625', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87ec4691-6c, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87ec4691-6c, col_values=(('qos', UUID('15c56a02-097c-49eb-8188-02beb2ef6567')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87ec4691-6c, col_values=(('external_ids', {'iface-id': '87ec4691-6c02-493b-b6de-9ef9d5e5f644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:7b:60', 'vm-uuid': '37319bfd-438b-495a-93a4-bc7e475f6533'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:45 user nova-compute[74075]: INFO os_vif [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c')
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:36:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No VIF found with MAC fa:16:3e:12:7b:60, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:36:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:46 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-e5df724c-dd2f-431b-8ff8-e192ce8c3044 req-57195bf4-abcc-4c34-b17d-0781b99aea0b service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e5df724c-dd2f-431b-8ff8-e192ce8c3044 req-57195bf4-abcc-4c34-b17d-0781b99aea0b service nova] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e5df724c-dd2f-431b-8ff8-e192ce8c3044 req-57195bf4-abcc-4c34-b17d-0781b99aea0b service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-e5df724c-dd2f-431b-8ff8-e192ce8c3044 req-57195bf4-abcc-4c34-b17d-0781b99aea0b service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG nova.compute.manager [req-e5df724c-dd2f-431b-8ff8-e192ce8c3044 req-57195bf4-abcc-4c34-b17d-0781b99aea0b service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] No waiting events found dispatching network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:36:47 user nova-compute[74075]: WARNING nova.compute.manager [req-e5df724c-dd2f-431b-8ff8-e192ce8c3044 req-57195bf4-abcc-4c34-b17d-0781b99aea0b service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received unexpected event network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 for instance with vm_state building and task_state spawning.
Oct 26 10:36:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:47 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:36:49 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Instance spawned successfully.
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:36:49 user nova-compute[74075]: INFO nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Took 5.05 seconds to spawn the instance on the hypervisor.
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-bd5516ac-c32c-472a-82f4-912a571c8214 req-5aff86d1-06d3-416e-a6aa-08fe26cba82f service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd5516ac-c32c-472a-82f4-912a571c8214 req-5aff86d1-06d3-416e-a6aa-08fe26cba82f service nova] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd5516ac-c32c-472a-82f4-912a571c8214 req-5aff86d1-06d3-416e-a6aa-08fe26cba82f service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bd5516ac-c32c-472a-82f4-912a571c8214 req-5aff86d1-06d3-416e-a6aa-08fe26cba82f service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.manager [req-bd5516ac-c32c-472a-82f4-912a571c8214 req-5aff86d1-06d3-416e-a6aa-08fe26cba82f service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] No waiting events found dispatching network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:36:49 user nova-compute[74075]: WARNING nova.compute.manager [req-bd5516ac-c32c-472a-82f4-912a571c8214 req-5aff86d1-06d3-416e-a6aa-08fe26cba82f service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received unexpected event network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 for instance with vm_state active and task_state None.
Oct 26 10:36:49 user nova-compute[74075]: INFO nova.compute.manager [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Took 22.73 seconds to build instance.
Oct 26 10:36:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:36:49 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=25.00995635986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-cfc18881-976b-4eed-9e58-fef509860cf9 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "37319bfd-438b-495a-93a4-bc7e475f6533" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.827s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 37319bfd-438b-495a-93a4-bc7e475f6533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:36:49 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:36:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:36:53 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:36:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:36:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 37319bfd-438b-495a-93a4-bc7e475f6533 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:37:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:37:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:37:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:37:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:37:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:37:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:37:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:37:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:37:50 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.00928497314453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 37319bfd-438b-495a-93a4-bc7e475f6533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:37:50 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:37:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:37:53 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:37:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:38:00 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 37319bfd-438b-495a-93a4-bc7e475f6533 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:05 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:10 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:38:15 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:17 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-changed-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:38:18 user nova-compute[74075]: DEBUG nova.compute.manager [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Refreshing instance network info cache due to event network-changed-87ec4691-6c02-493b-b6de-9ef9d5e5f644. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:38:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:38:18 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:38:18 user nova-compute[74075]: DEBUG nova.network.neutron [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Refreshing network info cache for port 87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:38:19 user nova-compute[74075]: DEBUG nova.network.neutron [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated VIF entry in instance network info cache for port 87ec4691-6c02-493b-b6de-9ef9d5e5f644. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:38:19 user nova-compute[74075]: DEBUG nova.network.neutron [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:38:19 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-38125296-ab07-444b-ba4c-37f7abeb6afe req-df71dd80-c51b-4d1b-8e20-988b1502c34e service nova] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:38:20 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:30 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Starting instance... {{(pid=74075) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74075) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 10:38:34 user nova-compute[74075]: INFO nova.compute.claims [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Claim successful on node user
Oct 26 10:38:34 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:38:34 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Start building networks asynchronously for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Allocating IP information in the background. {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] allocate_for_instance() {{(pid=74075) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 10:38:35 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Start building block device mappings for instance. {{(pid=74075) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.policy [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f870a45d74547d6ae2ce1395e2d1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd24b2446a4777af68ec4dea66f6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74075) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 10:38:35 user nova-compute[74075]: INFO nova.virt.block_device [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Booting with volume f2a378c6-3bb5-4365-9459-35b0641b21f0 at /dev/vda
Oct 26 10:38:35 user nova-compute[74075]: DEBUG os_brick.utils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077c326-6167-4c25-9969-43309868a916]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:165818c1746\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10d687-f8a4-4350-931f-ea66e0a06eda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1683079-80f9-430f-bc77-3a3fdf94ca33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[10871763-b732-4b7d-bf4e-c82f01f6ea4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Running cmd (subprocess): nvme version {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] 'nvme version' failed. Not Retrying. {{(pid=74075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] nvme not present on system {{(pid=74075) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 10:38:35 user nova-compute[74075]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 10:38:35 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce5e830-3552-48e7-a379-b5a8229381eb]: (4, '') {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74075) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] LIGHTOS: no hostnqn found. {{(pid=74075) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG os_brick.utils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:165818c1746', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.virt.block_device [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating existing volume attachment record: 0988c17b-2c0d-4b03-b28d-eae539712972 {{(pid=74075) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:35 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Successfully created port: e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Successfully updated port: e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquired lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Building network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-changed-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.compute.manager [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Refreshing instance network info cache due to event network-changed-e8d1002c-e078-49c7-b143-e85a9e1da0d7. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] Acquiring lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Instance cache missing network info. {{(pid=74075) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.network.neutron [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating instance_info_cache with network_info: [{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Releasing lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Instance network_info: |[{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74075) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] Acquired lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:38:36 user nova-compute[74075]: DEBUG nova.network.neutron [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Refreshing network info cache for port e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:38:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updated VIF entry in instance network info cache for port e8d1002c-e078-49c7-b143-e85a9e1da0d7. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:38:37 user nova-compute[74075]: DEBUG nova.network.neutron [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating instance_info_cache with network_info: [{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:38:37 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-626eee62-f801-4f48-b7d9-2abc155a1bfd req-1c241b50-2d0b-46b9-bc63-e1ae4177afb3 service nova] Releasing lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:38:40 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:45 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:50 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:38:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:38:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.00815200805664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 37319bfd-438b-495a-93a4-bc7e475f6533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance de22ec84-742c-4bca-a648-0dfd4e9e166e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:38:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Start spawning the instance on the hypervisor. {{(pid=74075) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Creating instance directory {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 10:38:53 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Creating image(s)
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Did not create local disks {{(pid=74075) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Ensure instance console log exists: /opt/stack/data/nova/instances/de22ec84-742c-4bca-a648-0dfd4e9e166e/console.log {{(pid=74075) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Start _get_guest_xml network_info=[{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '0988c17b-2c0d-4b03-b28d-eae539712972', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhUkwYyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de22ec84-742c-4bca-a648-0dfd4e9e166e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2a378c6-3bb5-4365-9459-35b0641b21f0', 'serial': 'f2a378c6-3bb5-4365-9459-35b0641b21f0'}, 'volume_type': None} {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 10:38:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:38:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller missing on host. {{(pid=74075) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.host [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU controller found on host. {{(pid=74075) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74075) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T09:19:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image limits 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flavor pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Image pref 0:0:0 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Got 1 possible topologies {{(pid=74075) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.hardware [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74075) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Calling os-brick to attach iSCSI Volume {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhUkwYyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:38:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:38:53 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:38:53 user nova-compute[74075]: INFO os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa86b0d-36b1-423b-b856-b6dd407db6f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 10:38:53 user nova-compute[74075]:  {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[589a2349-ecfe-4a34-99c5-359a722e1a30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0] added\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0] added
Oct 26 10:38:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2385a7-2c97-4198-aa0a-c693b60ea894]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e6906-a784-4323-823b-4cb2e4e5975e]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhUkwYyc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhUkwYyc" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[899da708-3f13-47d5-a0d2-64c2f55f6224]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GhUkwYyc'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cd3f20-4ec4-4237-99d1-e3ae5a869704]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[833e3da2-4fa0-4bdd-833a-7f84ec183fdb]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:38:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:38:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --login {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[923711c5-7c4e-4eac-9878-cffff181e597]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260]
Oct 26 10:38:53 user nova-compute[74075]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260] successful.
Oct 26 10:38:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7b8cfa-381a-43ff-93be-753d9d6217a6]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b96399-583e-4a99-b2fa-e25227059419]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:38:53 user nova-compute[74075]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 (non-flash)
Oct 26 10:38:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:38:53 user nova-compute[74075]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 (non-flash)
Oct 26 10:38:53 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to 172.16.0.220:3260 {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=74075) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74075) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66d008-26f0-40ae-9851-76326d633095]: (4, ('- - 0', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74075) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhUkwYyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74075) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26562343239333962', 'path': '/dev/sdc'} {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562343239333962', 'path': '/dev/sdc'} {{(pid=74075) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-988788171',display_name='tempest-TestVolumeBootPattern-server-988788171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-988788171',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-bqqv4u9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:38:35Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=de22ec84-742c-4bca-a648-0dfd4e9e166e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74075) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.objects.instance [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'pci_devices' on Instance uuid de22ec84-742c-4bca-a648-0dfd4e9e166e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 10:38:54 user nova-compute[74075]:   <uuid>de22ec84-742c-4bca-a648-0dfd4e9e166e</uuid>
Oct 26 10:38:54 user nova-compute[74075]:   <name>instance-00000034</name>
Oct 26 10:38:54 user nova-compute[74075]:   <memory>524288</memory>
Oct 26 10:38:54 user nova-compute[74075]:   <vcpu>1</vcpu>
Oct 26 10:38:54 user nova-compute[74075]:   <metadata>
Oct 26 10:38:54 user nova-compute[74075]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 10:38:54 user nova-compute[74075]:       <nova:package version="0.0.0"/>
Oct 26 10:38:54 user nova-compute[74075]:       <nova:name>tempest-TestVolumeBootPattern-server-988788171</nova:name>
Oct 26 10:38:54 user nova-compute[74075]:       <nova:creationTime>2023-10-26 10:38:53</nova:creationTime>
Oct 26 10:38:54 user nova-compute[74075]:       <nova:flavor name="m1.tiny">
Oct 26 10:38:54 user nova-compute[74075]:         <nova:memory>512</nova:memory>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:disk>1</nova:disk>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:swap>0</nova:swap>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:vcpus>1</nova:vcpus>
Oct 26 10:38:54 user nova-compute[74075]:       </nova:flavor>
Oct 26 10:38:54 user nova-compute[74075]:       <nova:owner>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:user uuid="2f870a45d74547d6ae2ce1395e2d1588">tempest-TestVolumeBootPattern-1296213444-project-member</nova:user>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:project uuid="f8dd24b2446a4777af68ec4dea66f6c7">tempest-TestVolumeBootPattern-1296213444</nova:project>
Oct 26 10:38:54 user nova-compute[74075]:       </nova:owner>
Oct 26 10:38:54 user nova-compute[74075]:       <nova:ports>
Oct 26 10:38:54 user nova-compute[74075]:         <nova:port uuid="e8d1002c-e078-49c7-b143-e85a9e1da0d7">
Oct 26 10:38:54 user nova-compute[74075]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 10:38:54 user nova-compute[74075]:         </nova:port>
Oct 26 10:38:54 user nova-compute[74075]:       </nova:ports>
Oct 26 10:38:54 user nova-compute[74075]:     </nova:instance>
Oct 26 10:38:54 user nova-compute[74075]:   </metadata>
Oct 26 10:38:54 user nova-compute[74075]:   <sysinfo type="smbios">
Oct 26 10:38:54 user nova-compute[74075]:     <system>
Oct 26 10:38:54 user nova-compute[74075]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 10:38:54 user nova-compute[74075]:       <entry name="product">OpenStack Nova</entry>
Oct 26 10:38:54 user nova-compute[74075]:       <entry name="version">0.0.0</entry>
Oct 26 10:38:54 user nova-compute[74075]:       <entry name="serial">de22ec84-742c-4bca-a648-0dfd4e9e166e</entry>
Oct 26 10:38:54 user nova-compute[74075]:       <entry name="uuid">de22ec84-742c-4bca-a648-0dfd4e9e166e</entry>
Oct 26 10:38:54 user nova-compute[74075]:       <entry name="family">Virtual Machine</entry>
Oct 26 10:38:54 user nova-compute[74075]:     </system>
Oct 26 10:38:54 user nova-compute[74075]:   </sysinfo>
Oct 26 10:38:54 user nova-compute[74075]:   <os>
Oct 26 10:38:54 user nova-compute[74075]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 10:38:54 user nova-compute[74075]:     <boot dev="hd"/>
Oct 26 10:38:54 user nova-compute[74075]:     <smbios mode="sysinfo"/>
Oct 26 10:38:54 user nova-compute[74075]:   </os>
Oct 26 10:38:54 user nova-compute[74075]:   <features>
Oct 26 10:38:54 user nova-compute[74075]:     <acpi/>
Oct 26 10:38:54 user nova-compute[74075]:     <apic/>
Oct 26 10:38:54 user nova-compute[74075]:     <vmcoreinfo/>
Oct 26 10:38:54 user nova-compute[74075]:   </features>
Oct 26 10:38:54 user nova-compute[74075]:   <clock offset="utc">
Oct 26 10:38:54 user nova-compute[74075]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 10:38:54 user nova-compute[74075]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 10:38:54 user nova-compute[74075]:     <timer name="hpet" present="no"/>
Oct 26 10:38:54 user nova-compute[74075]:   </clock>
Oct 26 10:38:54 user nova-compute[74075]:   <cpu mode="custom" match="exact">
Oct 26 10:38:54 user nova-compute[74075]:     <model>Nehalem</model>
Oct 26 10:38:54 user nova-compute[74075]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 10:38:54 user nova-compute[74075]:   </cpu>
Oct 26 10:38:54 user nova-compute[74075]:   <devices>
Oct 26 10:38:54 user nova-compute[74075]:     <disk type="block" device="disk">
Oct 26 10:38:54 user nova-compute[74075]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 10:38:54 user nova-compute[74075]:       <source dev="/dev/sdc"/>
Oct 26 10:38:54 user nova-compute[74075]:       <target dev="vda" bus="virtio"/>
Oct 26 10:38:54 user nova-compute[74075]:       <serial>f2a378c6-3bb5-4365-9459-35b0641b21f0</serial>
Oct 26 10:38:54 user nova-compute[74075]:     </disk>
Oct 26 10:38:54 user nova-compute[74075]:     <interface type="ethernet">
Oct 26 10:38:54 user nova-compute[74075]:       <mac address="fa:16:3e:31:73:d3"/>
Oct 26 10:38:54 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:38:54 user nova-compute[74075]:       <mtu size="1442"/>
Oct 26 10:38:54 user nova-compute[74075]:       <target dev="tape8d1002c-e0"/>
Oct 26 10:38:54 user nova-compute[74075]:     </interface>
Oct 26 10:38:54 user nova-compute[74075]:     <serial type="pty">
Oct 26 10:38:54 user nova-compute[74075]:       <log file="/opt/stack/data/nova/instances/de22ec84-742c-4bca-a648-0dfd4e9e166e/console.log" append="off"/>
Oct 26 10:38:54 user nova-compute[74075]:     </serial>
Oct 26 10:38:54 user nova-compute[74075]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 10:38:54 user nova-compute[74075]:     <video>
Oct 26 10:38:54 user nova-compute[74075]:       <model type="virtio"/>
Oct 26 10:38:54 user nova-compute[74075]:     </video>
Oct 26 10:38:54 user nova-compute[74075]:     <rng model="virtio">
Oct 26 10:38:54 user nova-compute[74075]:       <backend model="random">/dev/urandom</backend>
Oct 26 10:38:54 user nova-compute[74075]:     </rng>
Oct 26 10:38:54 user nova-compute[74075]:     <controller type="usb" index="0" model="none"/>
Oct 26 10:38:54 user nova-compute[74075]:     <memballoon model="virtio">
Oct 26 10:38:54 user nova-compute[74075]:       <stats period="10"/>
Oct 26 10:38:54 user nova-compute[74075]:     </memballoon>
Oct 26 10:38:54 user nova-compute[74075]:   </devices>
Oct 26 10:38:54 user nova-compute[74075]: </domain>
Oct 26 10:38:54 user nova-compute[74075]:  {{(pid=74075) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-988788171',display_name='tempest-TestVolumeBootPattern-server-988788171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-988788171',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-bqqv4u9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T10:38:35Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=de22ec84-742c-4bca-a648-0dfd4e9e166e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG os_vif [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0') {{(pid=74075) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b889aa8-389f-57b1-8165-bb717f6f220d', '_type': 'linux-noop'}}, row=False) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8d1002c-e0, may_exist=True, interface_attrs={}) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8d1002c-e0, col_values=(('qos', UUID('48c361ed-98c4-4f46-8c5e-b32a7016bb13')),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8d1002c-e0, col_values=(('external_ids', {'iface-id': 'e8d1002c-e078-49c7-b143-e85a9e1da0d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:73:d3', 'vm-uuid': 'de22ec84-742c-4bca-a648-0dfd4e9e166e'}),), if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:54 user nova-compute[74075]: INFO os_vif [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0')
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74075) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 10:38:54 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] No VIF found with MAC fa:16:3e:31:73:d3, not building metadata {{(pid=74075) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 10:38:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:38:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:38:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-05de9eb3-0b94-4cf2-a2ef-f93f66fff131 req-667c7ac4-fee4-46f1-88bc-eb0684c7d971 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:38:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05de9eb3-0b94-4cf2-a2ef-f93f66fff131 req-667c7ac4-fee4-46f1-88bc-eb0684c7d971 service nova] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05de9eb3-0b94-4cf2-a2ef-f93f66fff131 req-667c7ac4-fee4-46f1-88bc-eb0684c7d971 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:56 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-05de9eb3-0b94-4cf2-a2ef-f93f66fff131 req-667c7ac4-fee4-46f1-88bc-eb0684c7d971 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:56 user nova-compute[74075]: DEBUG nova.compute.manager [req-05de9eb3-0b94-4cf2-a2ef-f93f66fff131 req-667c7ac4-fee4-46f1-88bc-eb0684c7d971 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] No waiting events found dispatching network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:38:56 user nova-compute[74075]: WARNING nova.compute.manager [req-05de9eb3-0b94-4cf2-a2ef-f93f66fff131 req-667c7ac4-fee4-46f1-88bc-eb0684c7d971 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received unexpected event network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 for instance with vm_state building and task_state spawning.
Oct 26 10:38:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:56 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Instance event wait completed in 0 seconds for  {{(pid=74075) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Guest created on hypervisor {{(pid=74075) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 10:38:57 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Instance spawned successfully.
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Found default for hw_cdrom_bus of ide {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Found default for hw_disk_bus of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Found default for hw_input_bus of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Found default for hw_pointer_model of None {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Found default for hw_video_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Found default for hw_vif_model of virtio {{(pid=74075) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 10:38:57 user nova-compute[74075]: INFO nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Took 4.84 seconds to spawn the instance on the hypervisor.
Oct 26 10:38:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Checking state {{(pid=74075) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 10:38:58 user nova-compute[74075]: INFO nova.compute.manager [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Took 23.25 seconds to build instance.
Oct 26 10:38:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-ecd60dc1-f826-4aaf-a4f6-bd1c92517ee2 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.339s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-bde4798d-6c00-4a10-a3be-ca39dbc5306b req-76675268-7de9-4af8-8ea2-f17c3ba5dde6 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:38:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bde4798d-6c00-4a10-a3be-ca39dbc5306b req-76675268-7de9-4af8-8ea2-f17c3ba5dde6 service nova] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:38:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bde4798d-6c00-4a10-a3be-ca39dbc5306b req-76675268-7de9-4af8-8ea2-f17c3ba5dde6 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:38:58 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-bde4798d-6c00-4a10-a3be-ca39dbc5306b req-76675268-7de9-4af8-8ea2-f17c3ba5dde6 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:38:58 user nova-compute[74075]: DEBUG nova.compute.manager [req-bde4798d-6c00-4a10-a3be-ca39dbc5306b req-76675268-7de9-4af8-8ea2-f17c3ba5dde6 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] No waiting events found dispatching network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:38:58 user nova-compute[74075]: WARNING nova.compute.manager [req-bde4798d-6c00-4a10-a3be-ca39dbc5306b req-76675268-7de9-4af8-8ea2-f17c3ba5dde6 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received unexpected event network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 for instance with vm_state active and task_state None.
Oct 26 10:38:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:38:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:02 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 37319bfd-438b-495a-93a4-bc7e475f6533 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:39:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verify base images {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] 37319bfd-438b-495a-93a4-bc7e475f6533 is a valid instance name {{(pid=74075) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] de22ec84-742c-4bca-a648-0dfd4e9e166e is a valid instance name {{(pid=74075) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb
Oct 26 10:39:45 user nova-compute[74075]: WARNING nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Unknown base file: /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Removable base files: /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0 /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5 /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72 /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37 /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32 /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/496ec8886cd684a3a8df348036862fc142da2ec0
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c551d65d3b40c6c85bc008fa292d2bfdf4f4b4c5
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f532cfabde3e6fded26663de4a32d9c04dbfae4a
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/032f4610a2cc20412c3157fe1ff6ee2160e93c72
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a73329f52dcabdb9aeeca28473c688bfe52d3a37
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/210f5ebf8ffe5830213ede4a2f9c64ea5444ca0f
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d3ab19eeb9d81fa9a438e0a612c982c3e7f5f32
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/403d9959ddf9fe376b8582ea9f96b1eecdaf21eb
Oct 26 10:39:45 user nova-compute[74075]: INFO nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/965c5b03675fbf5d6d983a8df738d875cbe06c6c
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verification complete {{(pid=74075) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verify swap images {{(pid=74075) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 26 10:39:45 user nova-compute[74075]: DEBUG nova.virt.libvirt.imagecache [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Verify ephemeral images {{(pid=74075) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 26 10:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:39:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:39:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.006771087646484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 37319bfd-438b-495a-93a4-bc7e475f6533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance de22ec84-742c-4bca-a648-0dfd4e9e166e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:39:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:39:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:39:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:57 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:39:57 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:39:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating instance_info_cache with network_info: [{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:40:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:40:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:25 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-changed-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG nova.compute.manager [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Refreshing instance network info cache due to event network-changed-e8d1002c-e078-49c7-b143-e85a9e1da0d7. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] Acquiring lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] Acquired lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Refreshing network info cache for port e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updated VIF entry in instance network info cache for port e8d1002c-e078-49c7-b143-e85a9e1da0d7. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG nova.network.neutron [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating instance_info_cache with network_info: [{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:40:26 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-1c26a559-463a-4682-a36c-f73bdd4e7e70 req-a911662c-64ff-4a5c-a666-0296aaed4599 service nova] Releasing lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-changed-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Refreshing instance network info cache due to event network-changed-e8d1002c-e078-49c7-b143-e85a9e1da0d7. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] Acquiring lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] Acquired lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Refreshing network info cache for port e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:27 user nova-compute[74075]: INFO nova.compute.manager [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Terminating instance
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.compute.manager [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-0e8d9c5f-30e3-4cb6-87f2-e4b00ec17caa req-a44d111d-8e67-4f5d-888d-314a20b04a83 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-vif-unplugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0e8d9c5f-30e3-4cb6-87f2-e4b00ec17caa req-a44d111d-8e67-4f5d-888d-314a20b04a83 service nova] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0e8d9c5f-30e3-4cb6-87f2-e4b00ec17caa req-a44d111d-8e67-4f5d-888d-314a20b04a83 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-0e8d9c5f-30e3-4cb6-87f2-e4b00ec17caa req-a44d111d-8e67-4f5d-888d-314a20b04a83 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-0e8d9c5f-30e3-4cb6-87f2-e4b00ec17caa req-a44d111d-8e67-4f5d-888d-314a20b04a83 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] No waiting events found dispatching network-vif-unplugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.compute.manager [req-0e8d9c5f-30e3-4cb6-87f2-e4b00ec17caa req-a44d111d-8e67-4f5d-888d-314a20b04a83 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-vif-unplugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updated VIF entry in instance network info cache for port e8d1002c-e078-49c7-b143-e85a9e1da0d7. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.network.neutron [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating instance_info_cache with network_info: [{"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:40:27 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-3a60690b-679d-4227-81c0-1825b9c170ab req-3f44f26b-4a64-4da9-8e21-a8f7edf76109 service nova] Releasing lock "refresh_cache-de22ec84-742c-4bca-a648-0dfd4e9e166e" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:40:27 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Instance destroyed successfully.
Oct 26 10:40:27 user nova-compute[74075]: DEBUG nova.objects.instance [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'resources' on Instance uuid de22ec84-742c-4bca-a648-0dfd4e9e166e {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-988788171',display_name='tempest-TestVolumeBootPattern-server-988788171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-988788171',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:38:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-bqqv4u9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:38:58Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=de22ec84-742c-4bca-a648-0dfd4e9e166e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "address": "fa:16:3e:31:73:d3", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d1002c-e0", "ovs_interfaceid": "e8d1002c-e078-49c7-b143-e85a9e1da0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_vif [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8d1002c-e0, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48c361ed-98c4-4f46-8c5e-b32a7016bb13) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:28 user nova-compute[74075]: INFO os_vif [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:73:d3,bridge_name='br-int',has_traffic_filtering=True,id=e8d1002c-e078-49c7-b143-e85a9e1da0d7,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d1002c-e0')
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhUkwYyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:40:28 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd2d74a-8aa9-41a8-8607-9130a9721449]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:40:28 user nova-compute[74075]: No targets found.
Oct 26 10:40:28 user nova-compute[74075]: iSNS:
Oct 26 10:40:28 user nova-compute[74075]: No targets found.
Oct 26 10:40:28 user nova-compute[74075]: STATIC:
Oct 26 10:40:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0
Oct 26 10:40:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:40:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:40:28 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d
Oct 26 10:40:28 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:40:28 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:40:28 user nova-compute[74075]: FIRMWARE:
Oct 26 10:40:28 user nova-compute[74075]: No targets found.
Oct 26 10:40:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:40:28 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:40:28 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868063b-ce5b-4f54-ae01-44b2d36c35f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[3500a49e-6bd2-4d09-a0f9-7c9cf29ee523]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:40:28 user nova-compute[74075]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 (non-flash)
Oct 26 10:40:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:40:28 user nova-compute[74075]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 (non-flash)
Oct 26 10:40:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462869d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0'): ({'sdc'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Removing single pathed devices sdc {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4390e4-6d94-4105-a0f4-e97ef241b397]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527edd2-1fbf-408b-a860-14a5266f3eb7]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flushing IO for device /dev/sdc {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[53915c12-79fd-4caf-b098-5b068ebda9d4]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f989eb0-68f8-4730-ad00-7757e1a3ee22]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] SCSI volumes sdc have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef0fd1-cd7e-45e3-8917-c83b42e76889]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[102adf9b-2f20-41a9-917c-a701dad9b8b0]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260]
Oct 26 10:40:28 user nova-compute[74075]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0, portal: 172.16.0.220,3260] successful.
Oct 26 10:40:28 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a378c6-3bb5-4365-9459-35b0641b21f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a90d505-c73c-48b3-b994-0a43f8489c33]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== disconnect_volume: return (271ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:40:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Deleting instance files /opt/stack/data/nova/instances/de22ec84-742c-4bca-a648-0dfd4e9e166e_del
Oct 26 10:40:28 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Deletion of /opt/stack/data/nova/instances/de22ec84-742c-4bca-a648-0dfd4e9e166e_del complete
Oct 26 10:40:28 user nova-compute[74075]: INFO nova.compute.manager [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 26 10:40:28 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:28 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:40:28 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Took 0.42 seconds to deallocate network for instance.
Oct 26 10:40:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] Acquiring lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] No waiting events found dispatching network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:40:29 user nova-compute[74075]: WARNING nova.compute.manager [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received unexpected event network-vif-plugged-e8d1002c-e078-49c7-b143-e85a9e1da0d7 for instance with vm_state active and task_state deleting.
Oct 26 10:40:29 user nova-compute[74075]: DEBUG nova.compute.manager [req-a20a41c9-80c8-4361-84af-c56c40ad3fb1 req-55826be3-02de-4f40-8aca-f85779f5f261 service nova] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Received event network-vif-deleted-e8d1002c-e078-49c7-b143-e85a9e1da0d7 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:40:29 user nova-compute[74075]: INFO nova.compute.manager [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: de22ec84-742c-4bca-a648-0dfd4e9e166e] Took 0.86 seconds to detach 1 volumes for instance.
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:29 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Deleted allocations for instance de22ec84-742c-4bca-a648-0dfd4e9e166e
Oct 26 10:40:29 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-32759dc7-a5cf-4e9c-ac44-7a2e049e57ce tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "de22ec84-742c-4bca-a648-0dfd4e9e166e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:43 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74075) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 10:40:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:40:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.005878448486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Instance 37319bfd-438b-495a-93a4-bc7e475f6533 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74075) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing inventories for resource provider cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating ProviderTree inventory for provider cc391394-3043-4569-8b55-9a33029ee3cb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Updating inventory in ProviderTree for provider cc391394-3043-4569-8b55-9a33029ee3cb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing aggregate associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, aggregates: None {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Refreshing trait associations for resource provider cc391394-3043-4569-8b55-9a33029ee3cb, traits: COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74075) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:40:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:40:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:40:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:40:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:40:53 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:55 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:55 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74075) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 10:40:56 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:58 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:40:59 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:40:59 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:41:03 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:41:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Forcefully refreshing network info cache for instance {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG nova.objects.instance [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lazy-loading 'info_cache' on Instance uuid 37319bfd-438b-495a-93a4-bc7e475f6533 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG nova.network.neutron [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated the network info_cache for instance {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 10:41:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:08 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:41:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:13 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Cleaning up deleted instances {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 10:41:15 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] There are 0 instances to clean {{(pid=74075) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 10:41:18 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:23 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:41:28 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:41:30 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:33 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-changed-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG nova.compute.manager [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Refreshing instance network info cache due to event network-changed-87ec4691-6c02-493b-b6de-9ef9d5e5f644. {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] Acquiring lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] Acquired lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG nova.network.neutron [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Refreshing network info cache for port 87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "37319bfd-438b-495a-93a4-bc7e475f6533" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:38 user nova-compute[74075]: INFO nova.compute.manager [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Terminating instance
Oct 26 10:41:38 user nova-compute[74075]: DEBUG nova.compute.manager [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Start destroying the instance on the hypervisor. {{(pid=74075) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG nova.network.neutron [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updated VIF entry in instance network info cache for port 87ec4691-6c02-493b-b6de-9ef9d5e5f644. {{(pid=74075) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG nova.network.neutron [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [{"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:41:38 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-29233d03-9873-4a42-b807-6e41de011e74 req-7acbaffe-317f-47fa-a15d-bb3d4df34a77 service nova] Releasing lock "refresh_cache-37319bfd-438b-495a-93a4-bc7e475f6533" {{(pid=74075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 10:41:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [-] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Instance destroyed successfully.
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.objects.instance [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lazy-loading 'resources' on Instance uuid 37319bfd-438b-495a-93a4-bc7e475f6533 {{(pid=74075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.vif [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T10:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-115408278',display_name='tempest-TestVolumeBootPattern-server-115408278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-115408278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//1PO1fu/bv1sycr2P/EmyD2DxvVnIt5UrJ8jPOEtT5yrwu033OhvTKQJmowlP3IW6s1rDwoHXE6XZTdyZ7CHzh7Ea3T/2OM+Q/R/UQYt+zgrrzAKwNbxej95qcQ7+zA==',key_name='tempest-TestVolumeBootPattern-820220675',keypairs=<?>,launch_index=0,launched_at=2023-10-26T10:36:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8dd24b2446a4777af68ec4dea66f6c7',ramdisk_id='',reservation_id='r-wp48uudm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296213444',owner_user_name='tempest-TestVolumeBootPattern-1296213444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T10:36:49Z,user_data=None,user_id='2f870a45d74547d6ae2ce1395e2d1588',uuid=37319bfd-438b-495a-93a4-bc7e475f6533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converting VIF {"id": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "address": "fa:16:3e:12:7b:60", "network": {"id": "6f0030ee-7bb8-44bd-b62d-c196118a426f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1096735440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8dd24b2446a4777af68ec4dea66f6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ec4691-6c", "ovs_interfaceid": "87ec4691-6c02-493b-b6de-9ef9d5e5f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.network.os_vif_util [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c') {{(pid=74075) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_vif [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c') {{(pid=74075) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87ec4691-6c, bridge=br-int, if_exists=True) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c56a02-097c-49eb-8188-02beb2ef6567) {{(pid=74075) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:39 user nova-compute[74075]: INFO os_vif [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=87ec4691-6c02-493b-b6de-9ef9d5e5f644,network=Network(6f0030ee-7bb8-44bd-b62d-c196118a426f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ec4691-6c')
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] calling os-brick to detach iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c611840>, {'target_iqn': 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzsFaMAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 10:41:39 user nova-compute[74075]: WARNING os_brick.initiator.connectors.base [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c1449c-c951-4139-b4ff-467c382cffb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 10:41:39 user nova-compute[74075]: No targets found.
Oct 26 10:41:39 user nova-compute[74075]: iSNS:
Oct 26 10:41:39 user nova-compute[74075]: No targets found.
Oct 26 10:41:39 user nova-compute[74075]: STATIC:
Oct 26 10:41:39 user nova-compute[74075]: Target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d
Oct 26 10:41:39 user nova-compute[74075]:         Portal: 172.16.0.220:3260,-1
Oct 26 10:41:39 user nova-compute[74075]:                 Iface Name: default
Oct 26 10:41:39 user nova-compute[74075]: FIRMWARE:
Oct 26 10:41:39 user nova-compute[74075]: No targets found.
Oct 26 10:41:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 10:41:39 user nova-compute[74075]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 10:41:39 user nova-compute[74075]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74075) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d', 0)] {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0178bc-559d-4c5d-bdb7-4e66f91dadb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee092f1-d40b-4f75-b64f-7f310a9b0306]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:41:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d (non-flash)
Oct 26 10:41:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c138c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d'): ({'sdb'}, set())}) {{(pid=74075) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Removing single pathed devices sdb {{(pid=74075) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d1e14-77fa-418d-b471-e469a84ca54b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c80818-bb0c-4709-aab2-2b01db6cb573]: (4, ('ok\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Flushing IO for device /dev/sdb {{(pid=74075) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[453dbd17-fe31-471d-b588-01f06c338cbb]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74075) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42dcdb7-9d05-42d1-a405-eb942054ff05]: (4, ('1', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.linuxscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] SCSI volumes sdb have been removed. {{(pid=74075) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_44765067', '/dev/disk/by-id/scsi-1SCST_BIO44765067-8c05207bfbdaff8f', '/dev/disk/by-id/scsi-23863303532303762') {{(pid=85490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94074f7-0aff-4088-9e02-f32cd102d08a]: (4, None) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d')] {{(pid=74075) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1b9165-0b2e-4428-835f-20310ccd10da]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --logout {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d71814b-47a5-4109-96f0-3dadc992b008]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260]
Oct 26 10:41:39 user nova-compute[74075]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d, portal: 172.16.0.220,3260] successful.
Oct 26 10:41:39 user nova-compute[74075]:  stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op delete {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d18dc9-fd2a-429d-9eec-d7f5a33dc30d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.privsep.daemon [-] privsep: reply[a460b051-cc9d-406d-94ce-229eecaf47aa]: (4, ('', '')) {{(pid=85490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74075) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.base [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] <== disconnect_volume: return (288ms) None {{(pid=74075) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Disconnected iSCSI Volume {{(pid=74075) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 10:41:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Deleting instance files /opt/stack/data/nova/instances/37319bfd-438b-495a-93a4-bc7e475f6533_del
Oct 26 10:41:39 user nova-compute[74075]: INFO nova.virt.libvirt.driver [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Deletion of /opt/stack/data/nova/instances/37319bfd-438b-495a-93a4-bc7e475f6533_del complete
Oct 26 10:41:39 user nova-compute[74075]: INFO nova.compute.manager [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 26 10:41:39 user nova-compute[74075]: DEBUG oslo.service.loopingcall [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74075) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.compute.manager [-] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Deallocating network for instance {{(pid=74075) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 10:41:39 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] deallocate_for_instance() {{(pid=74075) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.network.neutron [-] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:41:40 user nova-compute[74075]: INFO nova.compute.manager [-] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Took 0.45 seconds to deallocate network for instance.
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-46b7e3f7-b7eb-45df-a85c-70b79d787856 req-61ad8d6a-0504-4b20-a9d3-5c9536cbcb13 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-vif-deleted-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:41:40 user nova-compute[74075]: INFO nova.compute.manager [req-46b7e3f7-b7eb-45df-a85c-70b79d787856 req-61ad8d6a-0504-4b20-a9d3-5c9536cbcb13 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Neutron deleted interface 87ec4691-6c02-493b-b6de-9ef9d5e5f644; detaching it from the instance and deleting it from the info cache
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.network.neutron [req-46b7e3f7-b7eb-45df-a85c-70b79d787856 req-61ad8d6a-0504-4b20-a9d3-5c9536cbcb13 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Updating instance_info_cache with network_info: [] {{(pid=74075) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-46b7e3f7-b7eb-45df-a85c-70b79d787856 req-61ad8d6a-0504-4b20-a9d3-5c9536cbcb13 service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Detach interface failed, port_id=87ec4691-6c02-493b-b6de-9ef9d5e5f644, reason: Instance 37319bfd-438b-495a-93a4-bc7e475f6533 could not be found. {{(pid=74075) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-vif-unplugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] No waiting events found dispatching network-vif-unplugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-vif-unplugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 for instance with task_state deleting. {{(pid=74075) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received event network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] Acquiring lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] Lock "37319bfd-438b-495a-93a4-bc7e475f6533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:40 user nova-compute[74075]: DEBUG nova.compute.manager [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] No waiting events found dispatching network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 {{(pid=74075) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 10:41:40 user nova-compute[74075]: WARNING nova.compute.manager [req-03aafce0-23c0-4c41-9b44-75d4f27469ea req-80dc4bf2-9128-4ac3-8dd4-3ff387c75dcf service nova] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Received unexpected event network-vif-plugged-87ec4691-6c02-493b-b6de-9ef9d5e5f644 for instance with vm_state active and task_state deleting.
Oct 26 10:41:40 user nova-compute[74075]: INFO nova.compute.manager [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] [instance: 37319bfd-438b-495a-93a4-bc7e475f6533] Took 0.80 seconds to detach 1 volumes for instance.
Oct 26 10:41:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:41 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:41:41 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:41:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:41 user nova-compute[74075]: INFO nova.scheduler.client.report [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Deleted allocations for instance 37319bfd-438b-495a-93a4-bc7e475f6533
Oct 26 10:41:41 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-bdcdc32c-d009-46d9-95f3-d00e249fc3d0 tempest-TestVolumeBootPattern-1296213444 tempest-TestVolumeBootPattern-1296213444-project-member] Lock "37319bfd-438b-495a-93a4-bc7e475f6533" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:41:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:41:52 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.004966735839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:41:52 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:41:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:41:58 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:41:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:00 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:42:04 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:06 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:42:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:42:07 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:42:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:42:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:42:15 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:42:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:42:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:42:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:42:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:42:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:48 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:51 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:42:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:42:53 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=24.988231658935547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:42:53 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:42:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:55 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:42:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:01 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:01 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:43:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:43:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:43:08 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:43:08 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:43:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:43:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:43:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:43:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:11 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:14 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:43:19 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:24 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:29 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:43:34 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:43:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:43:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:43:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:43:39 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:44 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:43:49 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Auditing locally available compute resources for user (node: user) {{(pid=74075) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:43:54 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:43:54 user nova-compute[74075]: WARNING nova.virt.libvirt.driver [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Hypervisor/Node resource view: name=user free_ram=9201MB free_disk=24.985729217529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74075) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74075) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.compute.provider_tree [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed in ProviderTree for provider: cc391394-3043-4569-8b55-9a33029ee3cb {{(pid=74075) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.scheduler.client.report [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Inventory has not changed for provider cc391394-3043-4569-8b55-9a33029ee3cb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74075) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG nova.compute.resource_tracker [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Compute_service record updated for user:user {{(pid=74075) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 10:43:54 user nova-compute[74075]: DEBUG oslo_concurrency.lockutils [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=74075) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 10:43:59 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:44:00 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:44:03 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:44:03 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74075) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 10:44:04 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:44:05 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:44:07 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Starting heal instance info cache {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Rebuilding the list of instances to heal {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG nova.compute.manager [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Didn't find any instances for network info cache update. {{(pid=74075) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74075) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74075) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 10:44:09 user nova-compute[74075]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74075) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 10:44:10 user nova-compute[74075]: DEBUG oslo_service.periodic_task [None req-d9c30583-4fc8-4abe-8047-9125ffb9e959 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74075) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}